Job Overview
Location
São Paulo
Job Type
Full-time
Category
Product Management
Date Posted
May 23, 2026
Full Job Description
📋 Description
- • Audit and evaluate the quality of AI-generated conversations in Brazilian Portuguese, focusing on linguistic accuracy, fluency, and naturalness.
- • Assess chatbot responses against predefined quality dimensions including coherence, relevance, grammatical correctness, cultural appropriateness, and tone consistency.
- • Provide detailed, constructive feedback on AI outputs to identify errors, inconsistencies, or unnatural phrasing that impact user experience.
- • Apply professional linguistic expertise to determine whether AI-generated text aligns with native Brazilian Portuguese usage and idiomatic norms.
- • Follow standardized evaluation guidelines and quality rubrics provided by the project team to ensure consistent and reliable assessments.
- • Deliver evaluations on a flexible schedule, completing a minimum of 10 hours per week at any time of day or night.
- • Work remotely with no fixed location requirements, using provided digital tools and platforms to submit evaluations and track progress.
- • Collaborate with a global team of linguists to contribute to the refinement of AI models designed for conversational interaction in Brazilian Portuguese.
- • Maintain high standards of accuracy and attention to detail across all evaluations, ensuring that feedback directly informs model improvements.
- • Participate in periodic quality calibration sessions to align with evolving evaluation criteria and project objectives.
- • Contribute to the advancement of AI-driven communication technologies by identifying edge cases, ambiguous phrasing, and culturally insensitive outputs.
- • Receive ongoing access to new evaluation tasks as they become available, with workload adjusted based on performance and availability.
- • Be considered for future opportunities within RWS’s vetted pool of linguists for similar AI quality assurance projects.
🎯 Requirements
- • Native or near-native proficiency in Brazilian Portuguese
- • Professional linguistic background or academic degree in translation
- • Ability to analyze and critique AI-generated text for linguistic quality and cultural appropriateness
- • Reliable internet connection and access to a computer for remote work
- • Availability to work a minimum of 10 hours per week on a flexible schedule
- • Strong attention to detail and consistency in applying evaluation criteria
🏖️ Benefits
- • Competitive rate of 25 USD per hour
- • Fully flexible schedule — work anytime, day or night
- • Remote work with no location constraints
- • Opportunity to be invited to future AI auditing projects as part of a vetted linguist pool
- • Exposure to cutting-edge conversational AI technologies
- • No fixed work hours or mandatory shifts
Skills & Technologies
About RWS Holdings plc
RWS Holdings plc is a global provider of intellectual property support services, translation, and localization solutions. Founded in 1958 and headquartered in the United Kingdom, the company serves law firms, corporations, and government agencies with patent translation, filing, and search services, as well as technical documentation and life-sciences linguistic support. RWS operates through divisions including PatBase, Moravia, and LUZ, combining AI-driven technology with expert linguists and subject-matter specialists. The group maintains offices across Europe, the Americas, and Asia-Pacific, enabling clients to secure, translate, and manage multilingual content and IP assets efficiently in regulated markets.
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
Similar Opportunities
Repurpose Global Inc.
4 months ago
3 months ago