Senior AI Engineer (Ops)

📋 Description

• • Join Latitude, a pioneering company at the forefront of AI-native gaming, and play a pivotal role in shaping the future of interactive entertainment. We are building a revolutionary platform that empowers developers and creators to craft entirely new kinds of immersive worlds, with AI serving as the fundamental bedrock of this new storytelling and play medium.
• • As a Senior AI Engineer (Ops), you will be instrumental in ensuring the seamless, reliable, and cost-effective operation of our production AI systems. This is a high-impact role where you will own the critical aspects of configuration, analytics, and monitoring for our cutting-edge AI infrastructure.
• • Your primary responsibility will be to develop and maintain robust AI request handlers, sophisticated generation configurations, and intelligent routing logic. This involves deep integration with our third-party model inference providers, ensuring optimal performance and efficient resource utilization.
• • You will be tasked with designing, implementing, and managing comprehensive monitoring systems. This includes building dashboards and setting up alerts to provide real-time visibility into the health, performance, and associated costs of our production AI systems. Proactive identification and resolution of issues will be key to maintaining service stability.
• • A significant part of your role will involve defining and tracking key metrics that are crucial for analyzing the health, efficiency, and overall effectiveness of our production AI resources. This data-driven approach will inform optimization strategies and future development efforts.
• • You will have the opportunity to create innovative agentic automations to streamline common AI infrastructure tasks and enhance our analytics pipelines. This will involve leveraging AI itself to improve the operational efficiency of our AI systems.
• • Managing and evolving database schemas for AI configurations and evaluation data will be another core responsibility, ensuring that our data infrastructure is scalable and supports our analytical needs.
• • You will collaborate closely with a talented team of builders and storytellers, contributing to the definition and implementation of best practices for AI system reliability, observability, and operational excellence.
• • This role requires a strong understanding of generative AI approaches, the current research landscape, and the intricacies of model inference configurations. Your expertise will be vital in making informed decisions about our AI stack.
• • You will leverage your strong coding skills in TypeScript, JavaScript, Python, or similar languages to build and maintain these critical systems. Proficiency in developing production systems that integrate with external APIs and manage third-party service dependencies is essential.
• • Familiarity with observability tools such as Grafana and Prometheus, along with experience in managing databases like PostgreSQL, will be highly beneficial in this role.
• • The ability to think systematically about the complex trade-offs between reliability, performance, and cost is paramount. You will need to balance the need for rapid iteration with the imperative of maintaining production stability in a fast-paced environment.
• • We are looking for individuals with low ego, who prioritize truth and collaboration, and are open to feedback. A deep sense of curiosity, a drive for continuous learning, and the ability to ask insightful questions are highly valued.
• • Signs of greatness, such as a proven track record of high achievement, a high output of quality work, and becoming a go-to expert, are indicators of a strong fit. We seek individuals who are systems thinkers, capable of mapping complex problems, identifying second-order effects, and creating scalable solutions.
• • As an obsessive builder, you will be driven to create, prototype, and iterate quickly, sharing your work and contributing to a culture of innovation. Strong product judgment, the ability to scope effectively, and a commitment to shipping with taste and data are also key attributes.
• • Finally, we seek mission-driven owners who care deeply about our product, prioritize our players, and see initiatives through to completion. If you thrive in ambiguity, learn by doing, and aim to exceed expectations, you will find a rewarding environment at Latitude.