Senior Applied Research Engineer 2

Drata, Inc.

Job Overview

Location

Hybrid - San Francisco

Job Type

Full-time

Full Job Description

📋 Description

• Design and evaluate information retrieval and reasoning strategies for AI systems using RAG, agentic workflows, and classic ML techniques including chunking, embedding models, hybrid search, and metadata filtering.
• Prototype GenAI workflows that map and reason over compliance objects such as controls, risks, requirements, and evidence to enhance the accuracy of Drata’s AI products.
• Explore and implement machine learning and probabilistic approaches—such as classifiers, ranking models, graph/link prediction, calibration, and structured prediction—where generative AI is not optimal.
• Build and maintain robust evaluation frameworks including golden datasets, automated quality metrics, and regression detection systems to measure AI performance.
• Implement and tune ranking and reranking systems using cross-encoders, LLM-based rerankers, learning-to-rank algorithms, and custom scoring functions to improve relevance.
• Conduct controlled experiments to validate hypotheses, quantify performance improvements, and ensure rigorous testing before production rollout.
• Debug failure modes across retrieval, reasoning, and generation components, and develop structured error taxonomies to guide system improvements.
• Collaborate closely with AI and Software Engineers to transition validated research prototypes into scalable, production-ready systems.
• Stay current with advancements in applied research areas including RAG, agentic systems, LLM evaluation, and relevance modeling, and integrate innovative techniques into Drata’s product stack.
• Own the scientific foundation of Drata’s AI-powered compliance platform components including VRM Agent, AIQA, Trust Agent, and policy-to-control mappers.
• Communicate complex research findings clearly to engineering teams and translate insights into actionable engineering tasks that drive product impact.
• Work in a hybrid model with in-office collaboration on Tuesdays through Thursdays in San Francisco; Mondays and Fridays are flexible for focused work.
• Contribute to a culture of ownership, speed, and customer obsession, where precision, velocity, and mission-driven outcomes are prioritized.

🎯 Requirements

• 6+ years of experience in applied research, data science, or machine learning with a focus on NLP, information retrieval, or knowledge systems
• 2+ years of hands-on experience building or contributing to production AI/ML systems
• Strong foundation in information retrieval including dense and sparse retrieval, embedding models, and search relevance
• Experience with RAG systems including chunking strategies, vector databases, and retrieval optimization
• Proficiency in evaluation methodology including metrics design, golden dataset creation, A/B testing, and statistical significance
• Strong Python skills and comfort with notebook-driven research workflows

🏖️ Benefits

• Stock equity in the form of Restricted Stock Units (RSUs) to share in company success
• Up to 100% employer-paid premiums for medical, dental, and vision coverage for employees and dependents
• Comprehensive financial benefits including 401(k) plan, company-paid life and disability insurance, and tax-advantaged spending accounts
• Paid Parental Leave after six months of employment, plus access to Kindbody fertility and family-building benefits
• Generous annual stipends for professional and personal development
• Flexible vacation policy with paid holidays and autonomy over work schedule on Mondays and Fridays

Skills & Technologies

Python

REST

Senior

Hybrid

$192k-259k

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Drata, Inc.

Visit Website

About Drata, Inc.

Drata is a compliance automation platform that continuously monitors and collects evidence for security frameworks such as SOC 2, ISO 27001, HIPAA, and PCI DSS. It integrates with cloud services, identity providers, and SaaS tools to track controls, manage risks, and generate audit-ready documentation. The company serves technology startups and enterprises seeking to streamline security compliance workflows and maintain continuous monitoring without manual spreadsheets.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.