Job Overview
Location
New Delhi
Job Type
Full-time
Category
Product Management
Date Posted
May 23, 2026
Full Job Description
đź“‹ Description
- • Audit and evaluate the quality of AI-generated conversational responses in Bengali, focusing on linguistic accuracy, cultural appropriateness, and contextual relevance.
- • Assess chatbot dialogues based on predefined quality dimensions including fluency, coherence, tone, grammar, semantic correctness, and adherence to intended intent.
- • Provide detailed, constructive feedback on AI outputs to identify errors, inconsistencies, or unnatural phrasing that impact user experience.
- • Apply academic or professional linguistic expertise to judge whether AI responses align with native Bengali usage patterns across formal, informal, and regional variants.
- • Follow structured evaluation guidelines and scoring rubrics provided by RWS to ensure consistent, objective assessments across all assigned tasks.
- • Flag and document edge cases, ambiguous inputs, or AI-generated content that may reflect bias, misinformation, or cultural insensitivity.
- • Maintain high standards of accuracy and attention to detail while reviewing large volumes of conversational data over time.
- • Collaborate with project leads to clarify evaluation criteria and report recurring patterns or systemic issues in AI model performance.
- • Work independently with minimal supervision, managing your own schedule within the part-time commitment of 10+ hours per week.
- • Deliver evaluations on time, adhering to project deadlines and quality benchmarks without compromising linguistic integrity.
- • Contribute to the iterative improvement of AI-driven communication systems by providing actionable insights derived from real-world linguistic analysis.
- • Engage with cutting-edge conversational AI technologies while ensuring human linguistic expertise guides their refinement and ethical deployment.
- • Participate in optional training sessions to familiarize yourself with evaluation tools, project updates, and evolving quality standards.
- • Maintain confidentiality of all project materials, data, and client information in accordance with RWS’s data protection policies.
- • Be eligible for future invitations to join RWS’s vetted pool of linguists for similar AI auditing projects in Bengali or other languages.
🎯 Requirements
- • Professional linguist or holder of an academic degree in translation
- • Native or near-native proficiency in Bengali with deep understanding of regional dialects and cultural context
- • Strong analytical skills to evaluate linguistic quality in AI-generated text
- • Ability to work independently with minimal supervision
- • Reliable internet access and device for remote work
- • Availability to work at least 10 hours per week on a flexible schedule
🏖️ Benefits
- • Competitive rate of 13.33 USD per hour
- • Fully flexible schedule — work anytime, day or night
- • Opportunity to be invited to RWS’s vetted pool for future AI auditing projects
- • Participation in a cutting-edge project shaping the future of conversational AI
Skills & Technologies
About RWS Holdings plc
RWS Holdings plc is a global provider of intellectual property support services, translation, and localization solutions. Founded in 1958 and headquartered in the United Kingdom, the company serves law firms, corporations, and government agencies with patent translation, filing, and search services, as well as technical documentation and life-sciences linguistic support. RWS operates through divisions including PatBase, Moravia, and LUZ, combining AI-driven technology with expert linguists and subject-matter specialists. The group maintains offices across Europe, the Americas, and Asia-Pacific, enabling clients to secure, translate, and manage multilingual content and IP assets efficiently in regulated markets.
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
Similar Opportunities
Extend Your Team, LLC
3 months ago
Affirm Holdings, Inc.
2 months ago
