Senior Technical Program Manager, Machine Learning Infrastructure

Cohere Inc.

Job Overview

Location

Canada

Job Type

Full-time

Full Job Description

📋 Description

• As a Senior Technical Program Manager for Machine Learning Infrastructure at Cohere, you will play a pivotal role in managing the program portfolio covering inference, efficiency, serving, and endpoints to ensure scalable infrastructure for a rapidly expanding user base of internal and external stakeholders.
• You will lead end-to-end coordination and execution across cross-functional teams, particularly with Modeling and customer-facing groups, identifying pain points, establishing processes, and improving engineering best practices to enable teams to focus on development while meeting user needs.
• You will operate within a global, remote-first, high-growth AI company co-headquartered in Toronto and San Francisco, with offices in key tech hubs worldwide, working alongside world-class engineers and researchers dedicated to advancing foundation AI models for enterprise adoption.
• You will have the opportunity to grow your impact by shaping both tactical execution and strategic direction, partnering with senior leaders, driving continuous improvement through incident management liaison, and scaling your expertise in one of the most dynamic AI infrastructure environments in the industry.

🎯 Requirements

• 5+ years of Technical Program Management experience focusing on Machine Learning Infrastructure, specifically covering model inference, serving, efficiency, and endpoints design & implementation
• In-depth technical knowledge around ML infrastructure design and implementation, as well as engineering best practices, supporting a balance of velocity and structure in rapidly growing organizations
• Experience working in a chaotic, fast-paced, low-structure environment, with the ability to be pragmatic, roll up sleeves, and function at both tactical and strategic levels to drive model success

🏖️ Benefits

• Weekly lunch stipend of $75/£75 or equivalent in local currency
• Full health and dental benefits, including a separate budget for mental health
• RRSP matching, 401K, Pension Scheme
• 100% Parental Leave top-up for up to 6 months for either parent
• 6 weeks of paid vacation (30 working days)
• Annual enrichment benefits including arts & culture, fitness/wellness, quality time, workspace improvement credit, and education & learning stipend for conferences, courses, and coaching
• Budget for traveling to other offices if remote, plus an annual company offsite
• Everyone receives a $500 home office stipend to set up workspace properly

Skills & Technologies

DevOps

Senior

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Cohere Inc.

Visit Website

About Cohere Inc.

Cohere provides large language models and retrieval-augmented generation APIs for enterprise developers to embed conversational AI, search, summarization, and content generation into applications. Founded in 2021 by former Google Brain researchers, the company offers cloud and on-premise deployment, fine-tuning tools, and multilingual support to help organizations automate workflows, improve customer support, and analyze unstructured data while maintaining data privacy and security controls.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.