Senior Full Stack QA Engineer (Freelance)

Toloka AI, Inc.

Job Overview

Location

European Union

Job Type

Full-time

Full Job Description

📋 Description

• Senior Full Stack QA Engineer (Freelance) at Toloka AI, Inc., responsible for ensuring quality across AI-powered systems that support leading GenAI models used by industry leaders like Anthropic, Amazon, Microsoft, and Shopify.
• Day-to-day responsibilities include taking end-to-end ownership of quality — from reviewing requirements and shaping test strategies to maintaining bug reports, tracking known issues, and surfacing bottlenecks; owning quality across the full system (AI agent, orchestration layer, user/operator interfaces); designing and maintaining automated tests for non-deterministic AI behavior; debugging issues in multi-component distributed systems; identifying high-risk areas and prioritizing effectively; using AI tools (Cursor, Copilot) to write and maintain tests efficiently; and shaping QA culture across teams without imposing rigid processes.
• Toloka AI is a well-funded, remote-first startup creating high-quality data to train and evaluate GenAI models, working with experts from over 50 domains and a global crowd from 100+ countries speaking 40+ languages. The team is distributed across the USA, UK, Netherlands, Israel, Czech Republic, Serbia, and more, backed by strategic investment from Bezos Expeditions and Nebius Group.
• In this role, you will deepen your expertise in testing AI-first products, gain hands-on experience with LLM-based systems and AI-augmented QA workflows, influence quality practices across engineering teams, and work on high-impact projects at the forefront of AI safety and efficacy evaluation.

🎯 Requirements

• 5+ years of QA experience with a strong manual testing foundation
• Experience testing complex, multi-component distributed systems
• Practical experience with test automation
• Familiarity with LLMs and AI-first products — understanding that non-determinism is not a bug
• Experience using AI tools (Cursor, Copilot, etc.) in daily workflow
• Strong prioritization skills and comfort operating in ambiguity

🏖️ Benefits

• Freelance collaboration via the Ontop platform
• Flexible, fully remote work schedule
• Opportunity to work on highly innovative projects at the leading edge of AI development with industry-leading clients
• Friendly, dedicated, and dynamic team of experts

Skills & Technologies

Full Stack

Senior

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Toloka AI, Inc.

Visit Website

About Toloka AI, Inc.

Toloka AI, Inc. operates a global data-labeling and human-in-the-loop platform that combines machine learning with crowdsourced human intelligence to generate high-quality training data for computer vision, NLP, search, and other AI applications. The company offers scalable annotation workflows, quality control systems, and expert taskers across 100+ countries to help enterprises and research teams accelerate model development and improve accuracy. Founded in 2014 and headquartered in Amsterdam, Toloka serves technology giants and startups in e-commerce, autonomous vehicles, finance, and healthcare sectors.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.