Job Overview
Location
California
Job Type
Full-time
Category
Product Management
Date Posted
May 23, 2026
Full Job Description
đź“‹ Description
- • Audit and evaluate the quality of AI-generated conversational responses in Vietnamese to ensure linguistic accuracy, cultural appropriateness, and contextual relevance.
- • Assess chatbot dialogues using predefined quality dimensions including fluency, coherence, tone, grammar, semantic correctness, and adherence to intended intent.
- • Provide detailed, constructive feedback on AI outputs to identify errors, inconsistencies, or unnatural phrasing that impact user experience.
- • Apply professional linguistic expertise to detect subtle nuances in Vietnamese language usage, including idiomatic expressions, register variation, and regional dialects.
- • Compare outputs from two distinct AI models to determine relative performance in generating natural, human-like Vietnamese conversations.
- • Follow structured evaluation guidelines and scoring rubrics provided by the project team to maintain consistency and reliability in assessments.
- • Document observations and rationale for each evaluation to support iterative improvements in AI training datasets and response algorithms.
- • Maintain high standards of accuracy and attention to detail across all assigned tasks, ensuring evaluations reflect native-level proficiency in Vietnamese.
- • Work independently with minimal supervision, managing time effectively to meet weekly hour commitments of 10+ hours.
- • Complete evaluations on a flexible schedule, choosing when to work within any 24-hour period to accommodate personal availability.
- • Contribute to the advancement of conversational AI technology by directly influencing the refinement of language models used in real-world applications.
- • Participate in occasional feedback sessions or briefings to clarify evaluation criteria or address emerging linguistic challenges in AI outputs.
- • Ensure all work complies with confidentiality agreements and data handling protocols for sensitive AI training materials.
- • Maintain consistent quality output across multiple evaluation cycles, adapting to updated guidelines or expanded scope as the project evolves.
🎯 Requirements
- • Native or near-native proficiency in Vietnamese with demonstrated professional or academic background in translation or linguistics
- • Academic degree in translation, linguistics, or a closely related field, or equivalent professional experience as a linguist
- • Strong analytical skills to evaluate complex conversational patterns and identify subtle linguistic flaws
- • Ability to work independently with minimal supervision and manage flexible part-time hours
- • Reliable internet connection and access to a computer for remote work
- • Familiarity with AI-driven language systems or conversational interfaces is preferred but not required
🏖️ Benefits
- • Competitive hourly rate of 23.33 USD
- • Fully flexible schedule — work anytime, day or night
- • Part-time commitment of 10+ hours per week with no fixed hours
- • Opportunity to be invited to join a vetted pool for future AI evaluation projects
Skills & Technologies
About RWS Holdings plc
RWS Holdings plc is a global provider of intellectual property support services, translation, and localization solutions. Founded in 1958 and headquartered in the United Kingdom, the company serves law firms, corporations, and government agencies with patent translation, filing, and search services, as well as technical documentation and life-sciences linguistic support. RWS operates through divisions including PatBase, Moravia, and LUZ, combining AI-driven technology with expert linguists and subject-matter specialists. The group maintains offices across Europe, the Americas, and Asia-Pacific, enabling clients to secure, translate, and manage multilingual content and IP assets efficiently in regulated markets.
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
Similar Opportunities
Hitachi, Ltd.
17 days ago
17 days ago