Senior Product Manager, RL Environments — Handshake AI

Handshake Technologies, Inc.

Job Overview

Location

San Francisco, CA

Job Type

Full-time

Full Job Description

📋 Description

• Own the end-to-end product experience for building and shipping reinforcement learning (RL) environments, transforming manual, weeks-long processes into a scalable, self-serve platform operated by a small team of field operators.
• Design and ship a platform that automates and productizes critical steps in RL environment creation—including data sourcing, de-identification, synthetic data generation, tool building, packaging, and quality assurance—reducing reliance on tribal knowledge and off-platform workflows.
• Define and deliver tooling that enables operators to run multiple RL environments in parallel, replacing manual data transformation, QA checks, and delivery cutoffs with in-product dashboards and workflows.
• Lead the roadmap for environment packaging and customer delivery systems to ensure labs receive portable, deployable environments that run reliably within their own infrastructure, minimizing last-minute rework and delivery delays.
• Establish and own the environment quality leveling framework (L1–L5 by vertical and persona), and build the QA tooling that converts manual reviews into automated, productized checks for environments, tasks, and rollouts.
• Partner closely with Engineering to define architecture and execution priorities for the Environment Factory, translating operator pain points into clear engineering requirements and engineering tradeoffs into operational workflows.
• Collaborate with Operations to map current manual processes, identify bottlenecks, and co-design solutions that reduce operator time per environment while maintaining or improving output quality.
• Work with Research to align environment specifications with frontier lab needs for post-training and verifier workflows, ensuring environments support the technical demands of model evaluation and tuning.
• Coordinate with Design to create intuitive, power-user-focused UX for operators who rely on the platform daily, prioritizing efficiency over polish in high-volume, high-stakes workflows.
• Align with GTM and customer teams to prioritize verticals based on market demand and customer feedback, ensuring platform development directly supports revenue-critical deliveries.
• Define, track, and improve key metrics including: environment lead time, number of environments delivered per quarter, percentage of steps completed in-platform vs. off-platform, quality level progression by vertical, QA pass rates for environments/tasks/rollouts, tool registry coverage, and operator time per environment.
• Serve as the central connective tissue between Operations and Engineering, acting as the primary translator of operational needs into technical requirements and engineering constraints into operational realities.
• Drive 0→1 product development in a fast-moving, research-adjacent space with no pre-existing playbook, requiring rapid iteration, ambiguity tolerance, and decision-making based on real-time feedback and data signals.
• Scope problems from informal Slack threads into fully formed PRDs and shipped features within hours, prioritizing speed and impact over rigid documentation processes.
• Use data-driven signals—such as lead time, throughput, quality scores, and operator feedback—to sequence roadmap items and unblock the most critical bottlenecks first.
• Build tools for internal users (operators, forward-deployed engineers, data teams) where the core success metric is reducing manual labor and empowering power users to work independently.
• Maintain a relentless focus on quality at the frontier-lab standard, ensuring every shipped environment meets the rigorous demands of leading AI research organizations.
• Contribute to shaping how career pathways evolve in the AI economy by enabling the training data infrastructure that powers model advancements for the world’s top AI labs and Fortune 50 companies.

🎯 Requirements

• 5+ years as a product manager shipping production code with engineering teams, ideally on platform, infrastructure, or developer-tools products.
• A track record building tools for internal users (operations, forward deployed engineers, data teams, or similar) where reducing manual work and supporting power users is the core of the job.
• Comfortable owning a product surface with many moving parts and dependencies (data pipelines, environment runtimes, tooling, QA, packaging) and sequencing roadmap work to unblock the biggest bottleneck next.
• Strong product instincts in ambiguous, fast-iterating spaces—can scope a problem from a Slack thread to a PRD to a shipped feature in hours, not days.
• Data-informed and action-oriented: use lead time, throughput, quality scores, and operator pain to prioritize, and move quickly once the signal is clear.
• Comfortable acting as the connective tissue between Operations and Engineering, translating ops pain into engineering work and engineering tradeoffs back into ops-readable plans.

🏖️ Benefits

• Equity in a fast-growing company
• 401(k) match, competitive compensation, financial coaching
• Paid parental leave, fertility benefits, parental coaching
• Medical, dental, and vision coverage, mental health support, $500 wellness stipend
• $2,000 learning stipend, ongoing development
• Internet, commuting, and free lunch/gym in SF office; flexible PTO, 15 holidays + 2 flex days
• Team outings & referral bonuses

Skills & Technologies

Product Management

Senior

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Handshake Technologies, Inc.

Visit Website

About Handshake Technologies, Inc.

Handshake Technologies provides a cloud-based career-services platform that connects university students, recent graduates, and employers. The software enables institutions to manage job postings, career fairs, on-campus interviews, and employer relations while giving students tools to discover internships and entry-level roles and giving employers access to early-career talent across a network of partner colleges and universities.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.