Senior Infra Engineer

📋 Description

• • LlamaIndex is at the forefront of defining the narrative around document understanding, a critical component in the evolution of Artificial Intelligence. We are seeking a Senior Infra Engineer to join our dedicated Infra team, which forms the bedrock of our product and provides the essential tools that empower our engineers to develop, deploy, and meticulously observe their code. This role is pivotal in designing, building, and scaling the core infrastructure that underpins a high-volume data platform specifically engineered for AI applications. If you are passionate about constructing robust, enabling systems that amplify the productivity of your fellow engineers and fuel our rapidly expanding product, this is your opportunity.
• • As a Senior Infra Engineer, you will be instrumental in shaping the future of AI infrastructure. Your primary focus will be on collaborating closely with diverse engineering teams to architect, implement, and maintain foundational systems. These systems are not just about keeping the lights on; they are about empowering our developers, fostering innovation, and ensuring the company's exponential growth is supported by a stable and scalable technological backbone. You will be a key player in designing and implementing sophisticated infrastructure solutions that cater to a variety of deployment models, including cutting-edge SaaS offerings, secure single-tenant environments, and robust private deployments, ensuring LlamaIndex can meet the diverse needs of its clientele.
• • A significant aspect of this role involves the meticulous management and continuous optimization of our cloud resources and Kubernetes clusters. You will be tasked with ensuring these critical components operate at peak efficiency, balancing cost-effectiveness with uncompromising performance. This includes identifying areas for improvement, implementing strategic changes, and monitoring the impact of your optimizations. Furthermore, you will play a crucial role in enabling the success of our external customers by diligently maintaining clear infrastructure boundaries and adhering to well-defined principles. This ensures that our customers can deploy and utilize LlamaIndex solutions with confidence and security, understanding the operational parameters and support structures in place.
• • Your expertise will also be vital in refining and enhancing our release and deployment processes. We are looking for someone who can bring a strategic vision to how we ship code, focusing on improving both the efficiency and the inherent reliability of our deployment pipelines. This means automating where possible, implementing best practices, and ensuring that our engineers can deliver new features and updates swiftly and without compromising stability. Security and compliance are paramount in the AI space. You will be responsible for ensuring our infrastructure adheres to relevant regulations and for implementing comprehensive security measures across all our different deployment environments, safeguarding our data and our customers' trust.
• • We are looking for individuals who possess a deep understanding of cloud infrastructure, have navigated various stages of scaling challenges, and are driven to make the broader Engineering team more effective and productive. The ideal candidate will embody LlamaIndex's core cultural traits: customer-obsession, a collaborative spirit, a strong work ethic, and an unwavering optimism. Above all, we seek owners – individuals who take initiative, drive projects to completion, and contribute to building a positive and high-performing engineering culture as we continue to grow and evolve. This is a chance to leave your mark on a company that is shaping the future of AI, building the essential infrastructure that powers groundbreaking innovation.