Educational Technology AI Rater & Evaluator

📋 Description

• • The Educational Technology AI Rater & Evaluator role at Lilt Production involves evaluating AI-generated educational content to ensure accuracy, safety, and pedagogical effectiveness, directly influencing the quality and readiness of multilingual AI systems used by enterprises and hyperscalers.
• • Day-to-day responsibilities include performing structured scoring, comparison, and classification of AI outputs; assessing learning effectiveness and identifying hallucinations or unsafe guidance; validating and refining evaluation rubrics; adjudicating rater disagreements; conducting error analyses; and collaborating with research and product teams on evaluation design—depending on whether the candidate is in the Rater (Track A) or Senior Evaluator (Track B) track.
• • Lilt Production is building a global network of domain experts to support AI evaluation across training, benchmarking, red-teaming, and model monitoring, with a mission to make the world’s information accessible across languages through human-verified AI services.
• • This role offers the opportunity to deepen expertise in AI evaluation within educational contexts, contribute to responsible AI development, refine judgment in multilingual learning scenarios, and build a professional network in a flexible, innovation-driven environment focused on advancing human knowledge through language technology.