German-Speaking AI Evaluation Specialist

📋 Description

• • As a German-Speaking AI Evaluation Specialist, you will play a critical role in assessing and improving the quality of AI-generated responses in German, ensuring they are accurate, relevant, and culturally appropriate for real user queries.
• • Day to day, you will evaluate and compare AI-generated responses in German, perform side-by-side analysis of outputs from different AI systems, assess responses for accuracy, relevance, clarity, and instruction-following, identify nuances in meaning, tone, and cultural context, apply structured annotation guidelines consistently, and work with datasets of real user queries.
• • Blueprint is a technology solutions firm headquartered in Bellevue, Washington, with a strong presence across the United States. The company is unified by a shared passion for solving complicated problems, leveraging technology as a tool to bridge the gap between strategy and execution, powered by the knowledge, skills, and expertise of its teams across multiple industries.
• • In this role, you will develop expertise in AI evaluation, gain hands-on experience with cutting-edge AI systems, refine your analytical and linguistic skills in a professional context, and contribute to the development of high-quality AI technologies while working collaboratively with diverse teams including data science and product development.