Job Overview
Location
Argentina - Fully Remote
Job Type
Contract
Category
Software Engineer
Date Posted
October 12, 2026
Full Job Description
📋 Description
- • Join Anyone AI Inc. as a Senior Software Engineer focused on Open Source & SWE‑Bench Evaluation, a project that scrutinizes real‑world software engineering tasks sourced from GitHub repositories.
- • Your primary responsibility will be to review and assess coding tasks that stem from actual GitHub issues and pull requests, ensuring they are technically sound, reproducible, well‑tested, and representative of everyday engineering challenges.
- • Evaluate whether each task’s problem statement is clear, the success criteria are complete, and the associated unit tests are correct, comprehensive, and robust.
- • Identify and flag flaky tests, missing dependencies, version conflicts, and any environment‑specific problems that could hinder reproducibility.
- • Analyze the difficulty and complexity of tasks, especially those involving multi‑file or cross‑module changes, to determine if they reflect realistic engineering workloads.
- • Provide concise, actionable written feedback and recommendations on whether a task should be accepted, improved, or excluded from the benchmark.
- • Leverage your deep experience with large, multi‑file codebases, pull‑request reviews, and production‑grade code maintenance to deliver high‑quality evaluations.
- • Apply your knowledge of unit testing principles, test coverage, and testing frameworks to judge the adequacy of test suites and suggest improvements.
- • Use your expertise in Git, GitHub workflows, dependency management, and environment setup to assess reproducibility and configuration requirements.
- • Collaborate with the Anyone AI team to refine task specifications, improve test designs, and enhance the overall quality of the SWE‑Bench dataset.
- • Contribute to the development of evaluation guidelines and best practices for open‑source code review within the organization.
- • Participate in periodic knowledge‑sharing sessions, presenting insights on common pitfalls in open‑source task design and testing strategies.
- • Maintain a high level of professionalism and clear communication, ensuring that feedback is constructive and actionable for task creators.
- • Work remotely from anywhere in Argentina, with flexible part‑time hours that accommodate project‑based consulting schedules.
- • Engage with a community of experienced engineers who enjoy debugging complex codebases, reviewing pull requests, and shaping the future of software engineering benchmarks.
🎯 Requirements
- • 3+ years of professional software engineering experience
- • Strong experience working with large, multi‑file codebases and reviewing pull requests
- • Deep understanding of unit testing, test coverage, and test design principles
- • Proficiency with Git, GitHub workflows, and dependency management
- • Ability to evaluate test suites for correctness, coverage, and robustness
- • Excellent written communication skills for providing clear technical feedback
🏖️ Benefits
- • Fully remote work from anywhere in Argentina
- • Flexible part‑time, project‑based consulting engagement
- • Opportunity to work on cutting‑edge open‑source evaluation projects
- • Collaboration with a team of seasoned engineers and researchers
- • Exposure to AI/ML evaluation, data curation, and benchmark development
- • Potential for future full‑time or expanded roles within Anyone AI Inc.
- • IMPORTANT CATEGORIZATION:
- • The role is a specialized Senior Software Engineer focused on open‑source code review and benchmark evaluation. The most specific child category is "Software Engineer" under the parent category "Engineering".
- • IMPORTANT LOCATION EXTRACTION:
- • "city": null
- • "region": null
- • "country_code": "AR"
- • "is_remote": true
Skills & Technologies
See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.
About Anyone AI Inc.
Anyone AI provides no-code computer-vision infrastructure that lets companies build, train and deploy image and video models without machine-learning teams. Its cloud platform automates data labeling, model optimization and edge deployment for retail, manufacturing, logistics and healthcare use cases. The company offers pre-trained APIs for object detection, counting and anomaly identification, plus dashboards for continuous monitoring and compliance. Founded in 2021, it targets enterprises seeking rapid AI adoption while avoiding costly specialists and infrastructure setup.
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
Similar Opportunities
4 months ago
Marigold Marketing Pty Ltd
12 hours ago
Red Hat, Inc.
4 months ago
The Vanguard Group, Inc.
4 months ago