
Job Overview
Location
Rome
Job Type
Full-time
Category
Product Management
Date Posted
May 23, 2026
Full Job Description
đź“‹ Description
- • Audit and evaluate the quality of AI-generated conversations in Italian, focusing on linguistic accuracy, fluency, and contextual appropriateness.
- • Assess chatbot interactions based on predefined core dimensions including grammar, syntax, coherence, tone, cultural relevance, and semantic fidelity.
- • Provide detailed, structured feedback on AI model outputs to identify strengths, weaknesses, and areas for improvement in conversational flow.
- • Apply professional linguistic expertise to detect errors such as mistranslations, unnatural phrasing, idiomatic inaccuracies, and inappropriate register usage.
- • Contribute to the refinement of AI models by highlighting patterns of failure or inconsistency across multiple dialogue samples.
- • Work independently with minimal supervision, adhering to detailed evaluation guidelines provided by the project team.
- • Maintain consistent quality standards across all assigned tasks, ensuring alignment with client expectations and project objectives.
- • Deliver evaluations in a timely manner, meeting weekly productivity targets while maintaining high precision and attention to detail.
- • Engage with a global team of linguists and AI specialists to support continuous improvement in multilingual conversational AI systems.
- • Participate in occasional feedback sessions or training updates to stay aligned with evolving evaluation criteria or project scope.
- • Work remotely with full flexibility to choose working hours, as long as a minimum of 10 hours per week is completed.
- • Contribute to a cutting-edge initiative shaping the future of AI-driven communication in the Italian language market.
- • Gain exposure to advanced natural language processing technologies and real-world AI deployment scenarios.
- • Receive regular project updates and performance feedback to support professional growth and task optimization.
🎯 Requirements
- • Professional linguist or holder of an academic degree in translation
- • Native or near-native proficiency in Italian
- • Demonstrated ability to analyze and critique written language with precision
- • Reliable internet access and ability to work independently in a remote environment
🏖️ Benefits
- • Competitive rate of 26.67 USD per hour
- • Fully flexible schedule — work anytime, day or night
- • Opportunity to join a vetted pool for future AI evaluation projects
- • Participation in a pioneering project at the forefront of conversational AI development
Skills & Technologies
See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.
About RWS Holdings plc
RWS Holdings plc is a global provider of intellectual property support services, translation, and localization solutions. Founded in 1958 and headquartered in the United Kingdom, the company serves law firms, corporations, and government agencies with patent translation, filing, and search services, as well as technical documentation and life-sciences linguistic support. RWS operates through divisions including PatBase, Moravia, and LUZ, combining AI-driven technology with expert linguists and subject-matter specialists. The group maintains offices across Europe, the Americas, and Asia-Pacific, enabling clients to secure, translate, and manage multilingual content and IP assets efficiently in regulated markets.
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
Similar Opportunities
6 months ago

Extend Your Team, LLC
3 months ago

Affirm Holdings, Inc.
2 months ago

Salvo Health, Inc.
9 months ago
