Japanese-Speaking AI Evaluation Specialist

📋 Description

• • Japanese-Speaking AI Evaluation Specialist role focused on assessing and improving the quality of AI-generated responses in Japanese, ensuring accuracy, relevance, and cultural appropriateness without involving translation.
• • Day-to-day responsibilities include evaluating and comparing AI-generated responses in Japanese, performing side-by-side analysis of outputs from different AI systems, assessing responses for accuracy, relevance, clarity, and instruction-following, identifying nuances in meaning, tone, and cultural context, applying structured annotation guidelines consistently, and working with datasets of real user queries.
• • Blueprint is a technology solutions firm headquartered in Bellevue, Washington, with a strong presence across the United States, unified by a passion for solving complicated problems using technology to bridge strategy and execution, powered by diverse teams with multi-industry expertise.
• • The role offers the opportunity to work with cutting-edge technology solutions, collaborate with data science and product development teams, gain hands-on experience in AI evaluation, and develop expertise in assessing AI behavior in Japanese language contexts while contributing to meaningful business impact.