Data Scientist, Integrity Measurement

OpenAI, Inc.

Job Overview

Location

London, UK

Job Type

Full-time

Full Job Description

📋 Description

• As a Data Scientist within OpenAI's Applied Foundations team, you will be at the forefront of safeguarding our revolutionary AI technologies against a spectrum of adversarial threats and misuse. Your primary mission will be to ensure the integrity and safety of our platforms as they scale globally, defending against financial abuse, sophisticated scaled attacks, and other malicious activities that could compromise user experience or operational stability.
• The Integrity pillar, a crucial component of Applied Foundations, is tasked with developing and managing the scaled systems that detect, identify, and respond to malicious actors and harmful content across OpenAI's platforms. As our systems mature in addressing severe forms of harm, we are expanding our team with skilled data scientists to enhance our capabilities in robustly measuring the prevalence of these issues and evaluating the effectiveness of our countermeasures.
• This role offers a unique opportunity to own the measurement and quantitative analysis for several critical, actor- and network-based usage harm verticals. You will be instrumental in estimating the prevalence of on-platform, and sometimes off-platform, harm, and conducting in-depth analyses to pinpoint gaps and identify opportunities for improving our response mechanisms.
• A key responsibility will be the development and implementation of AI-first methodologies for prevalence measurement and other productionized safety metrics. This may involve leveraging off-platform indicators and unconventional datasets to gain a comprehensive understanding of potential harms.
• You will be responsible for building and refining metrics that can be effectively used for goal-setting and A/B testing, particularly in scenarios where direct prevalence or top-line metrics are not sufficiently informative.
• Owning the creation and maintenance of dashboards and comprehensive metrics reporting for assigned harm verticals will be central to your role, providing clear visibility into safety performance.
• You will conduct rigorous analyses to generate actionable insights that directly inform improvements in review processes, detection algorithms, and enforcement strategies, thereby influencing the product roadmap.
• A significant aspect of this role involves optimizing Large Language Model (LLM) prompts specifically for the purpose of accurate and efficient measurement of harmful activities.
• You will collaborate closely with other safety teams to deeply understand their key concerns, contributing to the development of relevant policies that effectively support overarching safety needs.
• Providing essential metrics for leadership review and external reporting will be a regular part of your duties, ensuring transparency and accountability.
• To maximize your impact and efficiency, you will develop automation strategies, leveraging OpenAI's advanced agentic products to scale your efforts and amplify your reach.
• This position is based in our London office. Please note that the role may require resolving urgent escalations outside of normal working hours. Furthermore, many harm areas you will investigate may involve sensitive content, including but not limited to sexual, violent, or otherwise disturbing material, requiring a high degree of resilience and ethical consideration.
• You will be a senior data scientist with proven trust and safety experience, capable of driving the strategic direction of measurement initiatives.
• Deep statistical expertise is essential, particularly in sampling methods and the estimation of prevalence for complex problem areas, ideally focusing on activity-based rather than purely content-based harms.
• Experience working with severe and sensitive harm areas, such as child safety or violence, is highly desirable.
• Exceptional communication skills and a demonstrated ability to collaborate effectively across diverse, cross-functional teams are crucial for success.
• Proficiency in data programming languages such as R or Python, and SQL, is a prerequisite for this role.
• Ideally, you will have prior experience with AI-related harms or possess a strong understanding of how to leverage AI technologies for measurement purposes.

🎯 Requirements

• Proven experience as a senior Data Scientist with a specialization in Trust and Safety, capable of independently driving measurement strategy and execution.
• Deep statistical expertise, with a strong emphasis on sampling methodologies and the estimation of prevalence for complex, often activity-based, problem areas.
• Demonstrated experience in handling and analyzing data related to severe and sensitive harm verticals (e.g., child safety, violence, financial abuse).
• Excellent communication and interpersonal skills, with a strong track record of successful cross-functional collaboration.
• Proficiency in data programming languages (Python or R) and SQL for data manipulation, analysis, and modeling.
• (Ideally) Experience leveraging AI/ML for measurement purposes or a strong understanding of AI-specific harms.

🏖️ Benefits

• Competitive salary and equity in a rapidly growing company.
• Comprehensive health, dental, and vision insurance.
• Generous paid time off and holidays.
• Opportunities for professional development and continuous learning.
• A collaborative and innovative work environment with a mission-driven team.
• Potential for urgent escalations outside of normal hours, indicating a dynamic and impactful role.

Skills & Technologies

Python

Data Science

Onsite

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

OpenAI, Inc.

Visit Website

About OpenAI, Inc.

OpenAI is a San Francisco-based artificial intelligence research and deployment company founded in 2015. It develops large-scale AI models such as GPT, DALL-E, and Codex, providing cloud APIs and consumer applications like ChatGPT. Originally established as a non-profit, it later created a capped-profit subsidiary to attract capital while maintaining its mission to ensure artificial general intelligence benefits all of humanity.

View Company Profile