Job Overview
Location
Berlin
Job Type
Full-time
Category
Product Management
Date Posted
May 23, 2026
Full Job Description
đź“‹ Description
- • Audit and evaluate the quality of AI-generated chatbot conversations in German, ensuring linguistic accuracy, coherence, and contextual appropriateness.
- • Assess conversations against predefined quality dimensions including fluency, grammar, tone, cultural relevance, and semantic fidelity.
- • Provide detailed, structured feedback on AI outputs to identify errors, inconsistencies, or unnatural phrasing that impact user experience.
- • Apply professional linguistic expertise to determine whether AI responses align with native German usage patterns and idiomatic norms.
- • Review dialogues generated by two distinct AI models and compare their performance based on linguistic quality criteria.
- • Maintain consistent evaluation standards across all assigned tasks to ensure reliable, repeatable quality metrics for AI training.
- • Document observations and categorize issues according to specified taxonomies for internal reporting and model improvement.
- • Work independently with minimal supervision, adhering to project guidelines and quality benchmarks provided by RWS.
- • Deliver evaluations on a flexible schedule, completing a minimum of 10 hours per week at any time of day or night.
- • Contribute to the advancement of conversational AI technology by helping refine models to produce more natural, human-like German interactions.
- • Participate in occasional briefings or updates related to evaluation criteria, model updates, or project scope changes.
- • Ensure all work is completed with precision, attention to detail, and strict confidentiality regarding proprietary AI systems and data.
- • Maintain high throughput without compromising accuracy, balancing efficiency with linguistic rigor in high-volume evaluation tasks.
- • Collaborate virtually with a global team of linguists and project managers through digital platforms and task management tools.
- • Accept assignments as they become available, with no guaranteed minimum volume but opportunity for consistent work based on performance.
- • Be available to start immediately and remain responsive to project needs throughout the engagement period.
🎯 Requirements
- • Professional linguist or holder of an academic degree in translation
- • Native or near-native proficiency in German
- • Demonstrated ability to analyze and critique written language with precision
- • Access to a reliable internet connection and digital device for remote work
🏖️ Benefits
- • Competitive hourly rate of 33.34 USD
- • Fully flexible schedule — work anytime, day or night
- • Remote work with no location restrictions
- • Opportunity to be invited to a vetted pool for future similar projects
Skills & Technologies
About RWS Holdings plc
RWS Holdings plc is a global provider of intellectual property support services, translation, and localization solutions. Founded in 1958 and headquartered in the United Kingdom, the company serves law firms, corporations, and government agencies with patent translation, filing, and search services, as well as technical documentation and life-sciences linguistic support. RWS operates through divisions including PatBase, Moravia, and LUZ, combining AI-driven technology with expert linguists and subject-matter specialists. The group maintains offices across Europe, the Americas, and Asia-Pacific, enabling clients to secure, translate, and manage multilingual content and IP assets efficiently in regulated markets.
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
Similar Opportunities
Precision Medicine Group
1 month ago
3 months ago
