Product Manager, Models

📋 Description

• • As a Product Manager for AI Models at Heidi Health Pty Ltd, you will be at the forefront of innovation, owning the strategic direction and execution of the AI models that power our groundbreaking AI Care Partner.
• • This pivotal role involves defining the product strategy and roadmap for Heidi's models platform, encompassing critical areas such as model evaluation, safety protocols, model routing mechanisms, and the underlying fine-tuning infrastructure.
• • You will be instrumental in setting clear, measurable goals for your team and will be held accountable for their successful achievement, ensuring the continuous improvement and reliability of our AI capabilities.
• • A key responsibility will be to identify and address bottlenecks within the models platform that hinder the progress of user-facing product teams, proactively optimizing workflows and infrastructure to enhance their speed and efficiency.
• • You will lead the development of robust evaluation tooling and intuitive fine-tuning workflows, ensuring they are practical and usable for both engineers and product teams operating within demanding clinical settings.
• • Your decision-making process will be informed by a deep understanding of clinician feedback, crucial model quality signals, and the evolving needs of product teams, enabling you to prioritize improvements effectively.
• • You will expertly manage the allocation of engineering capacity across various product teams, balancing competing demands and communicating transparently about any deferred priorities.
• • Collaborating closely with engineers, you will engage in technical discussions regarding evaluation design, the trade-offs inherent in fine-tuning, and fundamental model architecture decisions.
• • A critical aspect of your role will be to establish stringent model quality and safety targets, directly linked to tangible clinical outcomes, such as the accuracy of diagnoses captured in notes or the completeness of referral letters.
• • You will proactively identify instances where different product teams are independently building similar infrastructure, driving consolidation efforts to foster efficiency and standardization across the platform.
• • Staying abreast of the latest advancements in foundation models, you will strategically assess their potential impact and be prepared to pivot your roadmap to incorporate groundbreaking developments.
• • In the past six weeks, a successful candidate would have defined and implemented an evaluation framework for model quality that is actively utilized by engineers.
• • They would have made decisive ship/hold decisions on model updates under pressure, clearly articulating the rationale to leadership.
• • They would have identified and proposed shared infrastructure solutions for overlapping model capability requests from different product teams.
• • A 90-day roadmap balancing immediate enablement needs with long-term model quality priorities would have been established.
• • Productive disagreements with senior engineers regarding prioritization would have been navigated, leading to mutually committed resolutions.
• • This role is fundamentally a platform role, meaning every user-facing product at Heidi relies on the foundational work delivered by your team, underscoring the significant impact and visibility of your contributions.
• • You will work in close partnership with product PMs and clinical safety experts, maintaining a close connection to product teams to anticipate their needs before they are formally requested.
• • The opportunity exists to transition from a deep technical involvement with AI models to a product-focused role, offering a unique career progression path for technically adept individuals.
• • Your work will directly contribute to Heidi's mission of strengthening the human connection in healthcare by enabling clinicians to focus on patient care rather than administrative burdens.
• • You will be a key player in scaling Heidi's AI Care Partner globally, supporting millions of patient sessions weekly across numerous countries and languages.
• • The role demands a proactive approach to understanding and mitigating risks associated with AI in a sensitive domain like healthcare, ensuring patient safety and trust are paramount.
• • You will champion best practices in AI model development, deployment, and monitoring, fostering a culture of continuous learning and improvement within the engineering and research teams.
• • Your strategic insights will guide the evolution of Heidi's AI capabilities, ensuring they remain at the cutting edge of medical technology and deliver maximum value to clinicians and patients alike.