Product Manager, Agent Harness & Modelling

Cohere Inc.

Job Overview

Location

Toronto

Job Type

Full-time

Full Job Description

📋 Description

• As the Agent Harness Product Manager at Cohere, you will own the execution layer that makes North agents reliable, capable, and production-ready, directly enabling enterprises to deploy AI agents securely within their infrastructure while ensuring data privacy and compliance—this role is critical to scaling intelligence to serve humanity through trustworthy, real-world AI applications.
• You will define and own the roadmap for North's agent harness, including the agent loop, context engineering layer, tool orchestration, sandbox execution, and sub-agent delegation, ensuring the platform can handle complex, multi-step enterprise workflows with robustness and precision.
• You will serve as the primary interface between North engineering and Cohere's Modeling team, aligning harness capabilities with model evolution through shared evaluation frameworks and validating design decisions before implementation to prevent misalignment between product and research.
• You will own North's agentic evaluation framework, designing metrics that measure task completion, failure recovery, and long-horizon reliability, and using them as a bridge to diagnose whether performance gaps stem from model limitations or scaffolding design.
• You will engage directly with enterprise customers to surface real-world agentic failures in production environments, translating operational insights into concrete product and model requirements that drive continuous improvement.
• You will stay current with the open-source and commercial agent ecosystem, evaluating emerging standards and tooling to ensure North's architecture remains aligned with industry best practices while maintaining its enterprise-grade security and scalability.
• You will contribute to architecture decisions at the implementation level, reviewing design docs, reasoning about async execution patterns, sandboxed environments, filesystem design for context offloading, and tradeoffs in tool permissioning and audit trails—acting as a technical product leader rather than a requirements handoff agent.
• You will work within a team of world-class researchers, engineers, and designers who are passionate about pushing the frontier of AI, where your contributions will directly influence how Canada's most important public institutions and global enterprises adopt and deploy frontier AI systems.
• You will have the opportunity to grow your expertise at the intersection of ML research and product engineering, gaining deep fluency in both domains and shaping how model capabilities are translated into reliable, scalable product features.

🎯 Requirements

• 5+ years of product management experience in agentic AI systems, developer infrastructure, or applied ML products
• Deep understanding of modern LLM agent architectures, including multi-agent systems, tool-augmented reasoning, memory and retrieval, programmatic orchestration, RAG, and long-horizon execution
• Strong grasp of agentic evaluation design, including how to measure task completion, failure recovery, and long-horizon reliability, and how to diagnose model vs. scaffolding gaps
• Technically deep enough to contribute to architecture decisions at the implementation level: comfortable reviewing and shaping design docs, reasoning about async execution patterns, sandboxed environments, filesystem design, and the tradeoffs that come with building harness capabilities into a production platform
• Ability to flex between ML research conversations and engineering architecture discussions with equal fluency
• Track record of shipping platform-layer products with demonstrated impact on reliability, performance, or capability

🏖️ Benefits

• Impact: Shape how Canada's most important public institutions adopt and deploy frontier AI.
• Innovation: Work alongside leading researchers and engineers solving complex ML challenges.
• Growth: Competitive compensation, equity options, and opportunities for professional development.
• Flexibility: Hybrid work model with offices in key global locations (Toronto, Montreal, New York, San Francisco, London, Paris, and Korea)
• Weekly lunch stipend, in-office lunches & snacks
• Full health and dental benefits, including a separate budget to take care of your mental health
• 100% Parental Leave top-up for up to 6 months
• Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
• Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
• 6 weeks of vacation (30 working days!)

Skills & Technologies

Product Management

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Cohere Inc.

Visit Website

About Cohere Inc.

Cohere provides large language models and retrieval-augmented generation APIs for enterprise developers to embed conversational AI, search, summarization, and content generation into applications. Founded in 2021 by former Google Brain researchers, the company offers cloud and on-premise deployment, fine-tuning tools, and multilingual support to help organizations automate workflows, improve customer support, and analyze unstructured data while maintaining data privacy and security controls.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.