Quality Analyst — Generative AI Data Quality

📋 Description

• • As a Quality Analyst for Generative AI Data Quality at Welocalize, Inc., you will play a pivotal role in ensuring the integrity, accuracy, and ethical sourcing of datasets that power cutting-edge AI models. You will be instrumental in shaping and executing client-specific quality programs, meticulously defining performance metrics, and expertly managing escalations. This role demands a proactive leader who can foster team development and orchestrate seamless cross-functional coordination, sharing accountability for client outcomes and overall team performance with the Operations Manager.
• • Your core responsibility will be to design and implement robust client QA strategies. This includes developing sophisticated sampling designs, defining precise audit methodologies, and establishing clear acceptance thresholds. You will be adept at adapting these strategies dynamically to accommodate changes in project scope and volume, ensuring continuous alignment with client objectives and evolving project needs.
• • A critical aspect of this role involves conducting thorough root-cause analyses for any quality deviations or performance issues. You will then drive the implementation of Corrective and Preventive Action (CAPA) plans, meticulously defining owners, setting realistic timelines, and establishing mechanisms for effectiveness checks to ensure lasting improvements.
• • You will be responsible for planning and overseeing the training and certification programs for our raters, annotators, and coordinators. This includes tracking completion rates and, crucially, measuring the impact of this training on individual and team performance, ensuring our workforce is equipped with the latest skills and knowledge.
• • Maintaining comprehensive dashboards is essential. You will track key performance indicators such as throughput, accuracy, productivity, and cost, transforming raw data into actionable insights. These insights will be the foundation for strategic decisions and operational adjustments aimed at optimizing performance and efficiency.
• • You will act as the primary point of contact for client escalations, demonstrating exceptional communication and problem-solving skills. This involves presenting clear options, outlining potential trade-offs, and proposing effective recovery paths to maintain client satisfaction and trust.
• • Standardizing operational procedures is key to scalability and consistency. You will develop and refine Standard Operating Procedures (SOPs), templates, and checklists, proactively identifying and removing bottlenecks in workflows to enhance efficiency and reduce friction.
• • You will have the opportunity to pilot small-scale automation initiatives, working closely with the Ops Tech team. This could involve developing macros, advanced templates, or exploring Robotic Process Automation (RPA) and API handoffs. Successful pilots will be scaled across projects, driving significant efficiency gains.
• • You will serve as a mentor and coach to P1s (Project Leads) and C2-C3 level personnel, guiding them on best practices for tools, workflows, and the critical craft of quality assurance. Your expertise will help elevate the skills and performance of the broader team.
• • Ensuring strict compliance with data handling protocols and platform access security is paramount. You will be responsible for upholding the highest standards of data privacy and security across all operations.
• • This role offers a unique opportunity to contribute to the advancement of AI by ensuring the quality of the data used to train and refine these powerful models. You will be at the forefront of a rapidly evolving field, working with innovative technologies and contributing to projects that have a real-world impact. Your work will directly influence the performance and reliability of AI systems, making you an indispensable part of the Welo Data team and Welocalize's mission to elevate client data.