This job has expired

This position was posted on November 14, 2025 and is likely no longer accepting applications. We've kept it here for historical reference. Check out the similar jobs below!

SDET II

Netomi AI Inc.

Job Overview

Location

Remote - India

Job Type

Full-time

Full Job Description

📋 Description

• Own end-to-end quality for Netomi’s award-winning agentic AI platform that powers customer experience for Delta Airlines, MetLife, MGM, United, and other Fortune 500 giants. You will be the last line of defense between our cutting-edge conversational AI and millions of real-world users.
• Design, execute, and evolve comprehensive test strategies for AI-driven chatbots, voice bots, and omnichannel self-service flows that span web, mobile, WhatsApp, Apple Messages for Business, and more. Your test plans will directly influence how quickly global brands can roll out AI agents that feel indistinguishable from human experts.
• Build and maintain a robust automation framework in Python that validates natural-language understanding (NLU), dialog management, sentiment analysis, and backend integrations at scale. You will push thousands of test conversations through our pipeline nightly, surfacing accuracy drifts before they ever reach a customer.
• Champion data-quality excellence across Product, Data Science, and Engineering squads by creating living dashboards that track intent precision, recall, F1 scores, and conversation success rates. When metrics dip, you will triage root causes—be it bad training data, model drift, or downstream API failures—and partner with teams to ship fixes within sprint boundaries.
• Perform deep manual exploratory testing of new AI capabilities—such as proactive agentic workflows, multilingual support, and generative response tuning—documenting edge cases that automated suites miss. Your detailed bug reports will include conversation logs, model confidence scores, and suggested training-data augmentations.
• Drive continuous improvement of our BDD-style acceptance criteria, turning ambiguous product requirements into concrete Gherkin scenarios that can be automated. You will coach developers and PMs on how to write testable stories that accelerate release cycles without sacrificing quality.
• Establish and enforce QA processes for rapid, remote-first teams: code-freeze criteria, hot-fix validation, canary release checklists, and post-mortems. Your playbooks will become the gold standard that keeps dozens of microservices and ML models in lock-step.
• Collaborate with DevOps to integrate quality gates into CI/CD pipelines (GitHub Actions, Docker, Kubernetes), ensuring every pull request triggers unit, API, contract, and end-to-end tests. You will also own the test-data strategy, spinning up ephemeral environments seeded with anonymized production conversations.
• Mentor junior QA engineers and interns, reviewing test cases, pair-programming automation scripts, and sharing best practices in weekly guild sessions. Your leadership will scale our quality culture as Netomi triples in size over the next 18 months.
• Stay ahead of the curve by evaluating emerging test tooling—LLM-based test generation, synthetic data creation, differential fuzzing—and piloting the ones that give us a competitive edge. Your experiments will shape our 2025 QA roadmap.

🎯 Requirements

• 4–6 years of hands-on QA experience with at least 2 years focused on testing AI/ML, chatbot, or NLP products
• Proven expertise in Python for test automation and API testing (requests, pytest, or similar)
• Solid grasp of Manual Testing concepts, test-case design techniques, and defect life-cycle management
• Bachelor’s degree in Computer Science, Engineering, or related technical discipline
• Nice-to-have: hands-on experience with Behavior-Driven Development (BDD) frameworks such as Behave or Cucumber

🏖️ Benefits

• Fully remote-first culture with flexible working hours across India time zones
• Opportunity to work on AI that serves millions of users for marquee global brands
• Backed by top-tier investors—WndrCo, Y Combinator, and Index Ventures—ensuring stability and growth
• Equal-opportunity workplace committed to diversity, inclusion, and continuous learning

Skills & Technologies

Python

MySQL

Remote

Degree Required

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Netomi AI Inc.

Visit Website

About Netomi AI Inc.

Netomi AI Inc. provides conversational AI software that automates customer support across email, chat, messaging, and voice channels. The platform integrates with CRM, e-commerce, and contact-center systems to resolve tickets, predict intent, and escalate complex issues to human agents. Founded in 2015, the company serves retail, telecom, financial services, and travel brands, measuring outcomes through containment rate, response time, and CSAT improvements. Headquartered in San Francisco with development offices globally, Netomi focuses on multilingual natural language understanding, reinforcement learning, and secure enterprise deployment.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.