Senior Software Engineer – AI Infrastructure

📋 Description

• • Kraken is at the forefront of the cryptocurrency revolution, driven by a mission to accelerate global adoption and empower individuals with financial freedom and inclusion. We are a world-class team of crypto enthusiasts united by a shared passion for discovering and unlocking the immense potential of blockchain technology. For over a decade, our unwavering focus on our mission and core crypto values has attracted some of the brightest minds in the industry, fostering an environment of innovation and expertise.
• • As a fully remote company, Krakenites hail from over 70 countries, speaking more than 50 languages. This global presence fuels our pioneering spirit as we develop premium crypto products for a diverse user base, ranging from experienced traders and institutions to newcomers entering the space. Our commitment extends to industry-leading security, comprehensive crypto education, and unparalleled client support, all delivered through our robust suite of products including Kraken Pro, Desktop, Wallet, and Kraken Futures.
• • The AI Infrastructure team is pivotal to this mission, tasked with building and operating the production systems that power intelligent agents at scale. This team forms the bedrock of our agent platform, ensuring that the critical layers of model inference, orchestration, and execution are not only reliable and observable but also performant under the demanding conditions of real-world load. We are the architects of the intelligent future at Kraken.
• • In this role, you will be instrumental in designing and constructing the foundational infrastructure that underpins our AI agent systems in production. This involves developing high-performance services, primarily written in Rust, that are responsible for the intricate processes of model inference, sophisticated orchestration, and efficient execution. Your work will directly impact the capabilities and scalability of our AI-driven products, ensuring they can seamlessly handle millions of users and a high volume of requests.
• • You will architect scalable systems that are built to withstand and thrive under significant user traffic and request throughput. A key aspect of your responsibility will be to build robust and reliable Machine Learning Infrastructure (MLI) and MLOps patterns. This includes establishing best practices for model deployment, rigorous evaluation methodologies, and proactive monitoring to ensure the continuous health and effectiveness of our AI models.
• • Furthermore, you will be responsible for defining critical guardrails, implementing comprehensive observability solutions, and designing sophisticated failure handling mechanisms for our agent-driven workflows. This proactive approach is essential for maintaining the integrity and stability of our systems in a high-stakes environment.
• • Your efforts will focus on optimizing key performance metrics across both the inference and orchestration layers, including latency, throughput, and cost-efficiency. This continuous optimization is crucial for delivering a superior user experience and maintaining operational excellence.
• • Collaboration is at the heart of our success. You will partner closely with the Agent Systems team, translating experimental prototypes into hardened, production-ready systems. This cross-functional synergy ensures that our innovations are effectively brought to life.
• • You will also contribute significantly to foundational infrastructure decisions within a high-scale, high-impact environment. Your technical expertise and strategic thinking will shape the future direction of our AI capabilities, ensuring Kraken remains at the cutting edge of the crypto and AI industries.
• • This is a deeply production-oriented role, demanding a blend of strong systems thinking, a pragmatic approach to engineering challenges, and hands-on experience with applied ML infrastructure. You will be working with Rust and operating services where performance and understanding failure modes are paramount. If you are passionate about building resilient, high-performance systems that power the next generation of intelligent applications in the exciting world of crypto, this is your opportunity to make a significant impact.