Senior AI Engineer, Tools & Agents

Twelve Labs Inc.

Job Overview

Location

San Francisco

Job Type

Full-time

Full Job Description

📋 Description

• We're hiring a senior AI engineer to own the integration layer that makes TwelveLabs' video AI accessible to the world.
• The engineer in this role decides how AI agents and developers connect to these capabilities, and you'll build the agent harness and the supporting infrastructure that makes that connection trustworthy at enterprise scale.
• The center of gravity is our MCP server. You'll own it end-to-end: how agents discover and invoke our capabilities, what the tool interfaces look like, how failure modes are handled, and how the surface evolves as the agentic ecosystem does.
• Everything else, auth, metering, rate limiting, is the substrate that makes that surface something an enterprise customer will trust.
• In this role, you will own the agent-facing integration surface, the auth and access substrate, the enterprise-readiness layer, and the research partnership.
• You'll work directly with our research team to turn frontier video and image understanding capabilities into durable product surfaces.
• The loop from research to what customers can build is short, and you're a key part of closing it.
• You'll decide how AI agents discover, connect to, and build on Jockey's retrieval and reasoning capabilities, and you'll be the person who knows what breaks and why.
• You'll design the auth and access substrate, including OAuth, RBAC, and multi-tenant isolation for enterprise customers.
• You'll define how the platform behaves under pressure before customers find out the hard way.
• You'll own the enterprise-readiness layer, including per-API-key usage tracking, rate limiting grounded in real system constraints, and the reliability work that makes the platform trustworthy under real load.
• You'll work with our research team to turn frontier video and image understanding capabilities into durable product surfaces.
• You'll be a key part of closing the loop from research to what customers can build.

🎯 Requirements

• You've shipped real agentic or LLM-powered systems. Not demos, but production systems with real users and real failure modes you had to debug and fix.
• You understand how retrieval, reasoning, and agent orchestration fit together as a system.
• You've owned a developer-facing or external API end-to-end, with real decisions about contracts, versioning, and the experience of building on top of your surface.
• You've built authentication and authorization in production, OAuth, OIDC, RBAC, or multi-tenant isolation, as a primary owner and not a consumer of someone else's framework.
• You've thought seriously about enterprise-readiness: what it takes to go from a capability that works to a platform that a large customer will trust with their data and workflows.
• You bring versatility across the full platform surface.
• You've operated in a fast-moving environment before, a startup, a hypergrowth company, or an AI-first team where you shipped under ambiguity without heavy process support.

🏖️ Benefits

• An open and inclusive culture and work environment.
• Work closely with a collaborative, mission-driven team on cutting-edge AI technology.
• Full health, dental, and vision benefits.
• Extremely flexible PTO and parental leave policy. Office closed the week of Christmas and New Years.
• VISA support where applicable.

Skills & Technologies

OAuth

Data Science

Senior

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Twelve Labs Inc.

Visit Website

About Twelve Labs Inc.

Twelve Labs builds multimodal video understanding AI. Its cloud platform transforms long-form video into vector embeddings that capture visual, audio, speech and contextual information, enabling semantic search, summarization, chaptering, moderation and analytics through a single API. Developers upload video, index it, then query in natural language or image to retrieve exact moments, generate highlights or detect unwanted content. Models are pretrained on large-scale web video, continually fine-tuned for accuracy and latency, and deployable on dedicated GPU clusters for enterprise security. Founded in 2021, the San Francisco company serves media, ed-tech, safety and e-commerce customers worldwide.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.