Product Manager, Safety Research

📋 Description

• • As a Product Manager for Safety Research at Cohere, you will play a pivotal role in bridging the gap between cutting-edge AI safety research and the practical implementation of safety features within Cohere's North product.
• • Your primary responsibility will be to translate complex findings from model evaluations, red-teaming exercises, and behavioral research into tangible product-level guardrails, controls, and safeguards that ensure the responsible deployment of AI.
• • You will own and drive the safety product roadmap for both Cohere and the North platform, strategically prioritizing features based on a deep understanding of research outcomes, observed patterns of misuse, evolving threat landscapes, and critical customer needs.
• • A key aspect of this role involves close collaboration with Cohere's modeling teams to meticulously scope and interpret safety evaluations. This requires a nuanced understanding of how Cohere's underlying models perform under adversarial conditions, in edge cases, and within high-stakes application scenarios.
• • You will be instrumental in defining and implementing robust evaluation frameworks designed to continuously assess the integrity of safety properties as models and product capabilities advance, proactively identifying and mitigating regressions before they impact customers.
• • This position demands coordination across research, engineering, and policy teams to architect and deploy effective guardrails and intervention mechanisms, determining the optimal placement and implementation strategy for safety controls within the North product layer.
• • You will maintain a vigilant watch over the rapidly evolving AI safety research landscape, staying abreast of emerging threats such as prompt injection, jailbreaks, and novel misuse patterns in agentic systems, ensuring that North's product roadmap remains responsive to these critical research insights.
• • A significant part of your contribution will involve establishing and refining processes for scaling safety reviews as the North platform's complexity and surface area expand, ensuring that new features undergo thorough safety risk assessments prior to launch.
• • This role is uniquely positioned for individuals who are deeply intellectually curious, thrive in environments characterized by ambiguity, and possess the technical acumen to engage meaningfully with sophisticated model behavior research.
• • You will leverage your product instincts to translate research findings into actionable product strategies, ensuring that Cohere's AI solutions are not only powerful but also inherently safe and trustworthy.
• • The ability to foster strong partnerships with researchers, engineers, and product stakeholders is crucial, ensuring alignment and progress without sacrificing the critical nuances of the underlying research.
• • You will be a key advocate for AI safety, championing best practices and innovative solutions that protect users and the integrity of Cohere's AI offerings.
• • This role offers a unique opportunity to influence the direction of enterprise AI safety, working at the forefront of AI development and contributing to the responsible advancement of artificial intelligence.
• • You will be responsible for understanding the implications of AI safety research on enterprise use cases, ensuring that Cohere's products meet the highest standards of security and reliability.
• • The position requires a proactive approach to identifying potential risks and developing preemptive measures to mitigate them, fostering a culture of safety consciousness throughout the product development lifecycle.
• • You will contribute to the development of clear documentation and communication strategies to articulate safety features and their benefits to both internal teams and external stakeholders.
• • Your work will directly impact the trust and confidence customers place in Cohere's AI solutions, making safety a core differentiator of the North platform.
• • This role is ideal for someone who is passionate about the ethical implications of AI and is driven to build AI systems that are beneficial and secure for society.
• • You will be empowered to make critical decisions regarding product safety, balancing innovation with robust risk management.
• • The opportunity to work with world-class researchers and engineers in a fast-paced, mission-driven environment makes this a truly exceptional career step.
• • You will be at the nexus of groundbreaking AI research and its real-world application, shaping the future of enterprise AI safety.