Legal & Compliance AI Rater/Evaluator

📋 Description

• • The Legal & Compliance AI Rater/Evaluator role at Lilt Production involves evaluating AI-generated legal and compliance content to ensure accuracy, safety, and alignment with regulatory standards, directly influencing the quality and trustworthiness of multilingual AI systems used by enterprises and governments.
• • Day-to-day responsibilities include performing structured scoring, classification, and judgment tasks on AI outputs; identifying hallucinations, ambiguity, or unsafe guidance; applying domain-specific guidelines consistently; and, for senior evaluators, refining rubrics, adjudicating disagreements, conducting error analyses, and partnering with research and product teams on evaluation design.
• • Lilt Production is building a global network of domain experts to support high-quality AI evaluation across training, benchmarking, red-teaming, and model optimization, with a mission to make the world’s information accessible across languages through innovation and human-verified services.
• • This role offers the opportunity to deepen expertise in AI safety and legal tech, contribute to responsible AI development, work flexibly on diverse global projects, and build professional credibility in a growing field at the intersection of law, compliance, and artificial intelligence.