AI Evaluator for Software Engineering - US and Canada only

G2i Inc.

Job Overview

Location

Miami

Job Type

Full-time

Full Job Description

📋 Description

• Senior AI Interaction Evaluator role focused on assessing the quality of AI coding agents like OpenAI Codex and Claude Code, where engineering taste and judgment matter more than writing production code.
• Day-to-day responsibilities include evaluating AI-generated coding interactions end-to-end, judging usefulness, correctness, and alignment with strong engineering reasoning, distinguishing response quality levels, and providing opinionated feedback on what works, what doesn’t, and what feels misleading.
• G2i Inc. is a technology company specializing in connecting top engineering talent with innovative projects; this role contributes to shaping how AI-assisted development tools evolve by defining what constitutes high-quality interaction.
• The role offers the opportunity to influence the future of AI in software engineering, refine evaluation standards for AI agents, and work with cutting-edge tools while leveraging deep engineering expertise in a flexible, high-impact contract position.

🎯 Requirements

• Staff or Principal-level software engineering experience (or equivalent)
• Strong background in TypeScript/JavaScript or Python
• Hands-on experience with OpenAI Codex, Claude Code, and Cursor
• Deep familiarity with modern AI-assisted development workflows
• Ability to evaluate code quality without executing or deeply reviewing every line
• Comfort giving direct, opinionated feedback based on engineering judgment

🏖️ Benefits

• Competitive rate of $100–$200 per hour
• Flexible schedule of 10–20 hours per week
• Fully remote work arrangement (US and Canada only)
• Immediate start with potential for extension beyond early May
• Opportunity to shape evaluation standards for AI coding agents
• Engagement includes a take-home exercise and one behavioral interview

Skills & Technologies

Python

JavaScript

TypeScript

Onsite

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

G2i Inc.

Visit Website

About G2i Inc.

G2i is a technical talent marketplace that pre-vets React, React Native, and Node.js engineers for U.S. companies. Founded by developers to solve hiring pain, it runs extensive code reviews, pair-programming interviews, and background checks before matching engineers for contract or full-time remote roles. G2i emphasizes mental health, offering a monthly wellness stipend and a zero-burnout policy. The company also provides direct-hire services and manages payroll, compliance, and ongoing support, enabling startups and enterprises to scale engineering teams quickly while maintaining code quality and developer well-being.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.