Senior Python Engineer - Functional Testing Project via Mindrift

Toloka AI, Inc.

Job Overview

Location

Remote

Job Type

Full-time

Full Job Description

📋 Description

• We are seeking a highly skilled and experienced Senior Python Engineer to join a critical project focused on the functional testing of complex AI systems. This is a unique opportunity to leverage your deep expertise in Python, functional testing methodologies, and your ability to navigate and understand codebases in multiple programming languages. As a project-based contributor through Mindrift, you will play a pivotal role in ensuring the quality, reliability, and performance of cutting-edge AI technologies for a leading tech company. Your work will directly impact the development and refinement of AI systems, contributing to their successful deployment and ongoing improvement.
• In this role, you will be responsible for designing and implementing comprehensive functional black-box tests for extensive codebases. This involves a meticulous approach to understanding system requirements and translating them into robust test cases that validate functionality without relying on internal code structure knowledge. You will need to be adept at identifying potential failure points and developing tests that cover a wide range of scenarios, ensuring that the AI systems perform as expected under various conditions.
• A core aspect of your contribution will be the creation and management of Docker environments. This is crucial for establishing 100% reproducible builds and ensuring consistent test execution across diverse platforms. Your expertise in containerization will guarantee that tests are run in a controlled and predictable manner, eliminating environmental variables as a source of error and providing reliable results. This meticulous attention to detail in environment setup is fundamental to the integrity of the testing process.
• You will also be tasked with monitoring code coverage meticulously and configuring automated scoring criteria. The goal is to achieve and maintain industry benchmark-level standards for code quality and test effectiveness. This involves defining clear metrics, implementing tools to track progress, and continuously refining the testing strategy to push the boundaries of quality assurance.
• A significant and innovative element of this role involves leveraging Large Language Models (LLMs) such as Roo Code and Claude Code to accelerate development cycles. You will explore and implement strategies to use these powerful AI tools to automate repetitive tasks, generate test code, analyze results, and improve overall code quality. This includes using LLMs to assist in understanding code written in languages you may not be intimately familiar with, such as C, Rust, or Go, enabling you to translate requirements and identify functional testing needs even within these diverse codebases.
• Your ability to read and interpret code across multiple languages, with the support of LLMs, will be essential. You will be expected to translate complex project requirements into actionable testing plans, identifying migration tasks and ensuring that the functional integrity of the system is maintained throughout any changes or updates.
• This project demands a proactive and analytical mindset. You will be expected to identify areas for improvement in the testing process, propose innovative solutions, and contribute to the overall efficiency and effectiveness of the project. Your experience in functional testing will be invaluable in guiding the development of test strategies that are both comprehensive and efficient.
• The ideal candidate will possess a strong understanding of software development lifecycles and best practices in quality assurance. You should be comfortable working independently and collaboratively within a remote team environment. The ability to communicate technical concepts clearly and concisely, both in written and verbal forms, is also highly valued.
• This role offers the chance to work on challenging and impactful projects at the forefront of AI technology. You will have the opportunity to expand your skillset by working with diverse programming languages and advanced AI tools, further solidifying your position as a senior engineer in the field. Your contributions will be instrumental in delivering high-quality AI solutions that meet the rigorous demands of leading technology companies.
• You will be instrumental in identifying and documenting bugs, providing detailed reports that enable developers to quickly understand and resolve issues. This requires a keen eye for detail and the ability to articulate technical problems effectively. Your feedback loop will be critical in the iterative improvement of the AI systems being tested.
• The project's success hinges on the accuracy and thoroughness of the functional testing performed. Therefore, a commitment to excellence and a passion for ensuring software quality are paramount. You will be a key guardian of the system's functional integrity, ensuring it meets all specified requirements and user expectations.
• This role is project-based, offering flexibility and the opportunity to engage in stimulating, short-to-medium term engagements with leading tech firms. Mindrift facilitates these connections, allowing you to focus on the technical challenges and project delivery without the complexities of traditional employment.

🎯 Requirements

• Proven experience as a Senior Python Engineer with a strong emphasis on functional testing methodologies.
• Demonstrated ability to create and manage Docker environments for reproducible builds and test execution.
• Proficiency in reading and understanding code across multiple programming languages (e.g., C, Rust, Go), with the ability to leverage LLMs for code comprehension and translation of requirements.
• Strong understanding of Linux operating systems and command-line tools.
• Excellent problem-solving skills and a meticulous attention to detail.

🏖️ Benefits

• Project-based work offering flexibility and diverse technical challenges.
• Opportunity to work with leading tech companies and cutting-edge AI technologies.
• Exposure to advanced tools like Roo Code and Claude Code for accelerated development.
• Competitive compensation for project contributions.
• Remote work environment, allowing for global participation.

Skills & Technologies

Python

Rust

Docker

Linux

Senior

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Toloka AI, Inc.

Visit Website

About Toloka AI, Inc.

Toloka AI, Inc. operates a global data-labeling and human-in-the-loop platform that combines machine learning with crowdsourced human intelligence to generate high-quality training data for computer vision, NLP, search, and other AI applications. The company offers scalable annotation workflows, quality control systems, and expert taskers across 100+ countries to help enterprises and research teams accelerate model development and improve accuracy. Founded in 2014 and headquartered in Amsterdam, Toloka serves technology giants and startups in e-commerce, autonomous vehicles, finance, and healthcare sectors.

View Company Profile