Consumer Goods & Retail AI Rater & Evaluator

📋 Description

• • The Consumer Goods & Retail AI Rater & Evaluator role at Lilt Production involves evaluating AI outputs related to consumer goods, retail operations, and commerce content to ensure accuracy, safety, and alignment with retail best practices. This role supports high-quality AI evaluation across training, benchmarking, red-teaming, and model monitoring for leading enterprises and hyperscalers.
• • Day-to-day responsibilities include performing structured scoring, comparison, classification, and judgment tasks; assessing factual accuracy, product relevance, clarity, and alignment with retail guidelines; identifying hallucinations, misleading product information, pricing errors, or policy violations; and applying domain-specific retail and consumer goods guidelines consistently across tasks. Senior evaluators also validate and refine evaluation rubrics, adjudicate rater disagreements, conduct error analysis, and partner with research and product teams on evaluation design.
• • Lilt Production is building a global network of domain experts to improve multilingual AI systems through human-in-the-loop evaluation. The company is committed to making the world’s information available in any language, delivering AI and human-verified services to enterprises, governments, and AI developers worldwide through innovation, inclusivity, and technical excellence.
• • In this role, you will deepen your expertise in AI evaluation workflows, contribute to the safety and reliability of multilingual AI systems, gain experience in red-teaming and model monitoring, and build a professional network within a global community of experts advancing human knowledge through responsible AI development.