Senior LLMOps Engineer

📋 Description

• • As a Senior LLMOps Engineer at Heidi Health Pty Ltd, you will play a pivotal role in shaping the future of AI-driven healthcare by leading the development and scaling of the infrastructure that underpins our cutting-edge AI Care Partner.
• • You will be instrumental in building and maintaining a robust, scalable, and highly reliable platform designed for the seamless deployment and management of our Large Language Models (LLMs), directly impacting the efficiency and effectiveness of clinicians worldwide.
• • Your primary mission is to architect and implement our comprehensive LLMOps strategy, empowering our AI engineers to transition models from development to production environments with unparalleled speed and efficiency.
• • This role demands a unique blend of deep infrastructure expertise and a profound understanding of MLOps principles to tackle the complex challenges associated with serving AI models at a global scale.
• • You will architect, design, and implement our end-to-end LLMOps platform, encompassing the entire model lifecycle from initial data ingestion and sophisticated model training pipelines to sophisticated production deployment strategies and continuous monitoring.
• • A key responsibility will be to build and maintain resilient CI/CD/CT (Continuous Integration/Continuous Delivery/Continuous Training) pipelines, automating the rigorous testing, validation, and deployment processes essential for large language models.
• • You will engineer highly available and scalable model serving solutions, leveraging modern cloud-native infrastructure such as Kubernetes, to guarantee low latency and high throughput for our critical production services.
• • This position requires close collaboration with our talented AI research and engineering teams, understanding their unique needs, streamlining their workflows, and developing bespoke tooling to significantly accelerate their development cycles.
• • You will be a champion for MLOps best practices, driving the adoption and implementation of standards for model versioning, meticulous experiment tracking, proactive monitoring, and robust governance across the entire organization.
• • As a senior member of the team, you will provide invaluable mentorship to mid-level and junior engineers, sharing your extensive expertise in infrastructure, automation, and operational excellence to cultivate a strong culture of reliability and scalability within the Model Platform team.
• • Your work will directly contribute to Heidi's mission of providing continuous and deeply human care by enabling clinicians to focus on what matters most: their patients.
• • You will be at the forefront of innovation in healthtech, working with a product that has already given back millions of hours to healthcare professionals and supported tens of millions of patient visits globally.
• • The role offers the opportunity to work with a diverse and talented team of doctors, engineers, designers, and researchers, all united by a passion for improving healthcare outcomes.
• • You will contribute to a product that is already making a significant impact, used in 116 countries and powering over two million patient visits each week.
• • Your efforts will be crucial in scaling our operations to meet the growing demand from leading health systems in the US, UK, Canada, and Europe.
• • This is a chance to be part of a rapidly growing, well-funded startup (nearly $100 million in funding) that is poised for significant future success.
• • You will be empowered to 'Own Your Practice,' where ideas are valued based on merit, and everyone shares responsibility for setting high standards.
• • You will experience a dynamic work environment that encourages moving fast while maintaining a steady focus on trust and reliability.
• • You will have the opportunity to 'Make Others Better' through honest feedback, consistent support, and shared growth, fostering continuous improvement within the team.