Applied Research Engineer

Drata, Inc.

Job Overview

Location

Hybrid - San Francisco

Job Type

Full-time

Full Job Description

📋 Description

• Design and evaluate information retrieval and reasoning strategies for AI systems using RAG, agents, and classic ML techniques including chunking, embedding models, hybrid search, and metadata filtering.
• Prototype generative AI workflows that map and reason over compliance objects such as controls, risks, requirements, and evidence.
• Explore and implement machine learning and probabilistic approaches where GenAI is suboptimal, including classifiers, ranking models, graph/link prediction, calibration, and structured prediction.
• Build and maintain evaluation frameworks with golden datasets, automated quality metrics, and regression detection systems to measure AI performance.
• Implement and tune ranking and reranking systems using cross-encoders, LLM-based rerankers, learning-to-rank algorithms, and custom scoring functions.
• Conduct controlled experiments to validate hypotheses and quantify performance improvements before deploying any approach into production.
• Debug failure modes across retrieval, reasoning, and generation components, and develop structured error taxonomies to guide system improvements.
• Collaborate closely with AI and Software Engineers to transition validated research prototypes into scalable, production-ready systems.
• Stay current with applied research in RAG, agentic systems, LLM evaluation, and relevance modeling, and integrate cutting-edge innovations into Drata’s product.
• Own the scientific foundation of Drata’s AI products including VRM Agent, AIQA, Trust Agent, and policy-to-control mappers that rely on high-quality information retrieval and reasoning.
• Communicate research findings clearly to engineering teams and translate technical insights into actionable product improvements.
• Work in a hybrid model with in-office collaboration Tuesdays through Thursdays in San Francisco; Mondays and Fridays are flexible for focused work.
• Contribute to a culture of ownership, speed, and customer obsession, where precision, velocity, and mission-driven outcomes are prioritized.
• Apply rigorous experimentation and evaluation over production engineering to ensure AI systems deliver accurate, reliable, and trustworthy compliance outcomes.

🎯 Requirements

• 3+ years of experience in applied research, data science, or ML with a focus on NLP, information retrieval, or knowledge systems
• 1+ years of hands-on experience building or contributing to production AI/ML systems
• Strong foundation in information retrieval: dense and sparse retrieval, embedding models, search relevance
• Experience with RAG systems: chunking strategies, vector databases, retrieval optimization
• Proficiency in evaluation methodology: metrics design, golden dataset creation, A/B testing, statistical significance
• Strong Python skills and comfort with notebook-driven research workflows

🏖️ Benefits

• Stock equity in the form of Restricted Stock Units (RSUs)
• Up to 100% employer-paid premiums for medical, dental, and vision coverage for employees and dependents
• Comprehensive financial benefits including 401(k), company-paid life and disability insurance, and tax-advantaged spending accounts
• Paid Parental Leave after six months of employment and access to Kindbody fertility and family-building benefits
• Generous annual stipends for professional and personal development
• Flexible vacation policy with paid holidays and hybrid work model (Tues–Thurs in-office in San Francisco)

Skills & Technologies

Python

REST

Hybrid

$145k-196k

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Drata, Inc.

Visit Website

About Drata, Inc.

Drata is a compliance automation platform that continuously monitors and collects evidence for security frameworks such as SOC 2, ISO 27001, HIPAA, and PCI DSS. It integrates with cloud services, identity providers, and SaaS tools to track controls, manage risks, and generate audit-ready documentation. The company serves technology startups and enterprises seeking to streamline security compliance workflows and maintain continuous monitoring without manual spreadsheets.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.