Member of Technical Staff, Safety for Agents

Cohere Inc.

Job Overview

Location

London

Job Type

Full-time

Full Job Description

📋 Description

• As a Member of Technical Staff in the Safety for Agents team at Cohere Inc., you will play a pivotal role in advancing the safety, reliability, and trustworthiness of next-generation Large Language Models (LLMs) that can interact with external tools and perform real-world actions. Your work will directly contribute to building AI systems that are not only powerful but also aligned with ethical principles and societal well-being, ensuring they operate safely in complex, dynamic environments.
• You will focus on designing and executing data generation strategies, developing post-training algorithms, and creating rigorous evaluation methodologies to assess and improve model safety, fairness, robustness, and generalizability. This includes collaborating with data annotation teams to curate high-quality, bias-aware datasets and working with cross-functional ML, product, and policy teams to translate safety research into production-ready model improvements.
• Day-to-day responsibilities include conducting statistical analysis of experimental results from data collection and model performance tests, designing and implementing scalable data pipelines for human-in-the-loop annotation, training and fine-tuning LLMs on distributed infrastructure (e.g., using PyTorch, TensorFlow, or JAX), and diagnosing model failures through error analysis and robustness testing.
• You will author technical documentation, present findings to interdisciplinary teams, and contribute to research publications targeting top-tier venues such as NeurIPS, ICML, ICLR, ACL, or EMNLP. Your role demands both deep technical execution and scientific curiosity, as you will tackle open problems in responsible AI where established solutions may not yet exist.
• You will join a small, high-autonomy team of experts distributed across London, Edinburgh, Paris, Toronto, and New York, operating within a culture that values intellectual rigor, fast-paced experimentation, and cross-disciplinary collaboration. The team is embedded within Cohere’s broader mission to scale intelligence responsibly, giving you direct influence over how safety considerations shape the frontier of agent-capable AI systems.
• This role offers unparalleled opportunity to grow as a technical leader in the emerging field of AI safety — gaining hands-on experience in cutting-edge LLM training, responsible data practices, and evaluation science while shaping standards that could influence industry-wide best practices for trustworthy AI deployment.

🎯 Requirements

• Strong statistical skills and experience evaluating scientific experiments related to data collection and model performance.
• Extremely strong software engineering skills with proficiency in Python and ML frameworks such as PyTorch, TensorFlow, or JAX.
• Hands-on experience training large language models (LLMs) on distributed training infrastructures.
• Expertise in designing and conducting data collection tasks, including managing workflows with human annotators and analyzing datasets for quality, bias, and suitability for ML training.
• Familiarity with evaluating and improving the generalizability and robustness of ML systems, particularly in the context of safety-critical applications.
• One or more peer-reviewed publications at top-tier venues (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP, MLSys, or Nature) demonstrating research impact in ML, AI safety, or related domains.

🏖️ Benefits

• Open and inclusive culture that values diversity and provides equal opportunities, with accommodation support available during recruitment.
• Weekly lunch stipend, in-office lunches and snacks, and full health and dental benefits including a dedicated mental health budget.
• 100% parental leave top-up for up to 6 months, personal enrichment benefits for arts, culture, fitness, well-being, and workspace improvement.
• Remote-flexible work policy with co-working stipend and access to offices in Toronto, New York, San Francisco, London, and Paris.
• 6 weeks of vacation (30 working days) annually to support rest, recovery, and long-term well-being.

Skills & Technologies

Python

TensorFlow

PyTorch

Senior

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Cohere Inc.

Visit Website

About Cohere Inc.

Cohere provides large language models and retrieval-augmented generation APIs for enterprise developers to embed conversational AI, search, summarization, and content generation into applications. Founded in 2021 by former Google Brain researchers, the company offers cloud and on-premise deployment, fine-tuning tools, and multilingual support to help organizations automate workflows, improve customer support, and analyze unstructured data while maintaining data privacy and security controls.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.