Job Overview
Location
India
Job Type
Full-time
Category
QA Engineer
Date Posted
February 28, 2026
Full Job Description
đź“‹ Description
- • Join Cognition, an applied AI lab at the forefront of innovation, as a pivotal QA Engineer. We are building end-to-end software agents, exemplified by our groundbreaking products, Devin, the first AI software engineer, and Windsurf, the AI-native IDE. These tools represent our vision for collaborative AI teammates, designed to elevate engineers by allowing them to concentrate on more stimulating challenges and empowering teams to pursue ambitious objectives. Our team is a concentrated group of exceptional talent, featuring individuals with backgrounds in competitive programming, successful entrepreneurship, and leadership roles at leading AI companies such as Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub, Modal, Google DeepMind, and Nuro. The creation of Devin and Windsurf is merely the commencement of our journey; the most significant challenges are yet to come. If you are driven by the prospect of solving some of the world's most substantial problems and are eager to contribute to the development of AI capable of sophisticated reasoning and real-world task execution, we invite you to apply and become an integral part of our mission.
- • As a QA Engineer at Cognition, you will be instrumental in ensuring the highest standards of quality for our revolutionary AI products. Your primary responsibility will be to own the end-to-end product quality across all AI workflows. This involves rigorously testing Windsurf and Devin, encompassing their onboarding flows, chat interactions, multi-file editing capabilities, agentic task execution, and autonomous workflows. You will adopt the mindset of a developer, anticipating their needs and potential pain points, while simultaneously testing from the perspective of a user to ensure a seamless and effective experience. Your role will demand a proactive and comprehensive approach to quality assurance, ensuring our products not only meet but exceed user expectations.
- • Key to your success will be the ability to design and execute comprehensive test strategies. You will be responsible for building and running a variety of test plans, including functional, regression, integration, exploratory, and end-to-end tests. These plans will span across all product surfaces and release cycles, ensuring thorough coverage and identification of potential issues before they impact users. A critical aspect of this role involves breaking down complex user flows and system behaviors into meticulously testable scenarios. This requires a keen eye for detail to identify edge cases, potential race conditions, failures in state recovery mechanisms, and real-world usage patterns that typically only surface during production-like operations. Your ability to anticipate and uncover these subtle yet critical issues will be paramount.
- • Furthermore, you will play a crucial role in issue reproduction, documentation, and debugging. When defects are identified, you will be tasked with reliably reproducing them, documenting them with clarity and precision, and debugging them across various layers of the system. This includes distinguishing between UI defects, orchestration or system-level issues, and unexpected AI behavior. You will collaborate closely with engineering and product teams to drive these issues to swift and effective resolution. Your insights will be invaluable in shaping the product's trajectory and ensuring its reliability.
- • Ownership of release readiness and the quality bar is another significant facet of this position. You will partner closely with engineering and product management to collaboratively define what constitutes a “done” feature or release. This involves setting clear quality standards and metrics, and diligently ensuring that all releases meet the high expectations of our target audience – real developers. Your judgment and commitment to quality will directly influence the success and adoption of our products.
- • Finally, you will contribute to building scalable QA processes and automation. This includes establishing robust QA playbooks and standardized test processes. You will identify opportunities to implement automation where it provides significant leverage, thereby increasing efficiency and test coverage. As the product scales, you will also help evolve our Continuous Integration/Continuous Deployment (CI/CD) pipelines and overall testing practices to ensure they remain effective and efficient in a rapidly growing environment. Your contributions will shape the future of QA at Cognition, ensuring we can maintain our high quality standards as we expand.
🎯 Requirements
- • 5+ years of QA/Test Engineering experience, with a proven track record of testing complex product workflows, including multi-step user journeys, cross-surface interactions, and end-to-end behavior.
- • Deep expertise in functional, regression, exploratory, integration, and end-to-end testing methodologies, with the ability to apply these effectively in a fast-paced AI product environment.
- • Strong developer mindset: comfortable reading and writing code (Python, TypeScript, or similar), navigating complex codebases, and reasoning about system architecture and behavior.
- • User-first testing approach: a demonstrated ability to test from the perspective of real users, anticipating their needs and potential frustrations, rather than solely adhering to specifications.
- • Exceptional attention to detail and strong debugging instincts, coupled with the ability to communicate clearly and precisely in bug reports and during triage discussions.
- • Familiarity with CI/CD pipelines and test automation frameworks, and comfort working in fast-moving, release-driven environments.
- • Schedule flexibility to overlap with US time zones, with an understanding that release cycles may occasionally require weekend availability.
- • Experience testing AI-powered products with non-deterministic outputs (strong plus).
- • Experience testing IDE plugins/extensions or developer tools (VS Code extensions, CLIs, code review systems) (strong plus).
- • Familiarity with AI coding tools (Windsurf, Copilot, Cursor, Devin, etc.) and informed opinions on what constitutes high quality in this domain (strong plus).
- • Prior software engineering background with shipped production code (strong plus).
🏖️ Benefits
- • Competitive salary and equity package.
- • Comprehensive health, dental, and vision insurance.
- • Generous paid time off and holidays.
- • Opportunity to work on cutting-edge AI technology with a world-class team.
- • Professional development and learning opportunities.
- • Flexible work arrangements and a collaborative work environment.
Skills & Technologies
Python
TypeScript
Onsite
About Cognition
Cognition is an applied AI lab renowned for creating Devin, the groundbreaking AI software engineer. This innovative platform is designed to automate complex software development tasks, serving enterprise clients and teams seeking to enhance efficiency in their engineering workflows. Devin's capabilities extend to areas like automating .NET framework migrations and serving as a data analyst, as demonstrated by customers like Eight Sleep. The company's credibility is underscored by its talent-dense team, whose founders boast 10 IOI gold medals and prior experience from leading AI firms such as Google DeepMind and Scale AI, positioning Cognition at the forefront of AI-driven software development.
