Customer Service & Support AI Rater & Evaluator

📋 Description

• • The Customer Service & Support AI Rater & Evaluator role at Lilt Production involves evaluating and improving multilingual AI systems used in customer-facing support environments, directly influencing model quality, safety, and deployment readiness for enterprise and hyperscaler clients.
• • Day-to-day responsibilities include performing structured scoring, comparison, classification, and judgment of AI outputs related to customer service interactions; assessing accuracy, clarity, tone, helpfulness, and alignment with support best practices; identifying hallucinations, misleading responses, policy violations, or unsafe guidance; and applying domain-specific guidelines consistently across tasks.
• • Lilt Production is building a global network of domain experts to support high-quality AI evaluation across training, benchmarking, red-teaming, and ongoing model monitoring, serving leading enterprises and AI developers worldwide with a mission to make information accessible across languages.
• • In this role, you will deepen your expertise in AI evaluation workflows, contribute to shaping evaluation standards, gain experience in red-teaming and model readiness assessments, and build a professional network while working flexibly on diverse, impactful projects from anywhere.