Model Evaluation & Data Quality Lead

Twelve Labs Inc.

Job Overview

Location

San Francisco

Job Type

Full-time

Full Job Description

📋 Description

• As a Model Evaluation & Data Quality Lead at Twelve Labs, you will play a vital role in the ML Data Team, driving the full spectrum of video-language data preparation and model evaluation to ensure the performance and reliability of cutting-edge multimodal foundation models.
• You will design and build robust model evaluation frameworks, manage resource allocation and timelines for data projects, collaborate with external partners to enhance data quality, establish labeling guidelines, and partner with engineering and AI teams to align on data needs and communicate progress through analytical reports and dashboards.
• Twelve Labs is a well-funded AI innovator backed by NVIDIA’s NVentures, NEA, and other top-tier VCs, pioneering multimodal foundation models that understand video like humans, with headquarters in San Francisco and a global presence in Seoul, committed to transforming media interaction through technology.
• In this role, you will gain deep expertise in AI data operations, model evaluation frameworks, and multimodal AI systems while leading cross-functional initiatives that directly impact model performance and scalability in a high-growth, mission-driven environment.

🎯 Requirements

• 5+ years of experience working in an AI focused data operations organization
• Proven track record designing and executing large scale data or evaluation projects, including gathering, labeling, and post-processing data
• Proficiency with Python, LLMs, or other popular industry tools for automation
• Excellent communication and project management skills, and the ability to support several projects simultaneously
• Foundational understanding of and interest in LLMs/VLMs and multimodal AI

🏖️ Benefits

• An open and inclusive culture and work environment
• Opportunity to work closely with a collaborative, mission-driven team on cutting-edge AI technology
• Full health, dental, and vision benefits
• Flexible PTO and parental leave policy, with office closed the week of Christmas and New Years

Skills & Technologies

Python

Pandas

Jupyter

Senior

Onsite

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Twelve Labs Inc.

Visit Website

About Twelve Labs Inc.

Twelve Labs builds multimodal video understanding AI. Its cloud platform transforms long-form video into vector embeddings that capture visual, audio, speech and contextual information, enabling semantic search, summarization, chaptering, moderation and analytics through a single API. Developers upload video, index it, then query in natural language or image to retrieve exact moments, generate highlights or detect unwanted content. Models are pretrained on large-scale web video, continually fine-tuned for accuracy and latency, and deployable on dedicated GPU clusters for enterprise security. Founded in 2021, the San Francisco company serves media, ed-tech, safety and e-commerce customers worldwide.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.