Job Overview
Location
Austin, Texas
Job Type
Full-time
Category
Software Engineering
Date Posted
June 4, 2026
Full Job Description
đź“‹ Description
- • Design and execute structured, statistically rigorous experiments to evaluate and improve Mia, an AI voice agent handling inbound patient calls for healthcare providers, ensuring changes are evidence-based and not speculative.
- • Build and maintain regression test coverage for prompt changes to detect unintended behavioral disruptions across multi-turn, voice-first healthcare workflows.
- • Develop a validated pipeline of high-confidence AI improvements that Engineering can reliably integrate, replacing intuition-driven updates with data-backed decisions.
- • Own the end-to-end design of prompts across Mia’s agent workflows, optimizing for clarity, compliance, and effectiveness in a healthcare context with sensitive patient interactions.
- • Stay current with emerging research in prompt engineering, agentic architectures, and LLM evaluation, translating academic and industry advancements into testable prototypes.
- • Independently prototype new prompting techniques and agent behaviors locally before any changes are deployed to production environments.
- • Serve as the primary resource for Product and Engineering teams when resolving complex prompting challenges, providing clear technical guidance grounded in experimental results.
- • Translate experimental findings into actionable, non-technical recommendations that align stakeholders across product, engineering, and clinical operations.
- • Create reusable evaluation templates, behavioral test suites, and validation frameworks to institutionalize rigorous AI assessment practices beyond individual initiatives.
- • Evaluate and interpret model behavior to understand why specific prompts succeed or fail, identifying root causes of errors, hallucinations, or misalignments in patient-facing interactions.
- • Collaborate with cross-functional teams to prioritize experimentation efforts based on impact, feasibility, and alignment with healthcare compliance and patient safety standards.
- • Ensure all AI improvements adhere to healthcare data security and regulatory requirements, maintaining HIPAA-compliant practices in experimentation and deployment.
- • Document and share knowledge through internal wikis, presentations, and peer reviews to ensure institutional memory and scalability of prompting best practices.
- • Act as a bridge between research and engineering, converting abstract AI concepts into concrete, testable hypotheses and measurable outcomes.
- • Monitor real-world patient call data to identify patterns of failure or inefficiency that warrant targeted prompting interventions.
- • Contribute to the definition of success metrics for AI agent performance, including accuracy, resolution rate, patient satisfaction, and clinician time saved.
🎯 Requirements
- • 5+ years of experience in a prompting, AI research, or applied AI role
- • Advanced degree in a research-oriented field (PhD preferred) in CS, linguistics, cognitive science, stats, or similar
- • Real prompt engineering experience — deliberately designing, testing, and improving prompts to change system behavior
- • Solid experimental design fundamentals: controls, statistical significance, knowing when a result actually means something
- • Hands-on experience working with LLMs in applied contexts
- • Comfort with RAG, agentic architectures, and modern LLM tooling
🏖️ Benefits
- • Base salary: $180,000 - $230,000
- • Meaningful equity ownership in a fast-growing healthtech startup
- • Work on an AI voice agent used in real healthcare settings with direct patient impact
- • Collaborate with a founding team with proven experience scaling technology at Carbon Health
Skills & Technologies
About Hellopatient Inc.
Hellopatient is a digital health company focused on improving patient care coordination and communication. They offer a platform that connects patients with their healthcare providers, streamlining appointment scheduling, prescription refills, and access to medical records. The company aims to reduce administrative burdens for clinics and empower patients with more control over their health journey. Their services are designed for various medical practices, enhancing efficiency and patient engagement within the healthcare ecosystem. Hellopatient operates within the rapidly growing digital health and healthtech industries, leveraging technology to make healthcare more accessible and manageable.
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
Similar Opportunities
Workato, Inc.
4 days ago
Nebius Group N.V.
3 months ago
Deepgram Inc.
2 months ago