Staff Applied Research Engineer

Drata, Inc.

Job Overview

Location

Hybrid - San Francisco

Job Type

Full-time

Full Job Description

📋 Description

• Design and evaluate information retrieval and reasoning strategies for RAG, agentic systems, and classic ML approaches including chunking, embedding models, hybrid search, metadata filtering, structured retrieval, and multi-step workflows.
• Prototype Generative AI workflows that map and reason over compliance objects such as controls, risks, and regulatory requirements using document-heavy compliance artifacts like VRM Agent, AIQA, and Trust Agent.
• Explore and implement machine learning and probabilistic alternatives to GenAI where appropriate, including classifiers, ranking models, graph/link prediction, calibration, and weak supervision techniques.
• Build, maintain, and scale evaluation frameworks with golden datasets, automated quality metrics, regression detection systems, and statistical analysis to quantify AI performance improvements.
• Implement and tune ranking and reranking systems using cross-encoders, LLM-based rerankers, learning-to-rank algorithms, and custom scoring functions to enhance retrieval relevance.
• Conduct controlled experiments to validate hypotheses and measure impact before production rollout, ensuring rigorous scientific validation of AI approaches.
• Debug failure modes across retrieval, reasoning, and generation components, and develop structured error taxonomies to guide system improvements.
• Collaborate closely with AI and Software Engineers to transition validated research prototypes into production systems while maintaining ownership of quality metrics and evaluation standards.
• Stay current with applied research in RAG, LLM evaluation, relevance modeling, and information retrieval, and actively integrate novel techniques into Drata’s compliance automation platform.
• Own the scientific foundation for Drata’s AI features, ensuring accuracy, trustworthiness, and reliability in automated compliance documentation and regulatory summarization.
• Work within a hybrid model in San Francisco, collaborating in-office Tuesday through Thursday for high-impact team alignment and innovation, with flexible remote work on Mondays and Fridays.
• Translate complex research findings into actionable engineering recommendations and communicate technical insights effectively to cross-functional teams.
• Contribute to the evolution of Drata’s AI-driven compliance platform by applying rigorous research methodologies to real-world security and regulatory challenges.

🎯 Requirements

• 10+ years of experience in applied research, data science, or ML with a focus on NLP, information retrieval, or knowledge systems
• 2+ years of hands-on experience building or contributing to production AI/ML systems
• Strong foundation in information retrieval including dense and sparse retrieval, embedding models, and search relevance
• Experience with RAG systems including chunking strategies, vector databases, and retrieval optimization
• Proficiency in evaluation methodology including metrics design, golden dataset creation, A/B testing, and statistical analysis
• Strong Python skills and comfort with notebook-driven research workflows

🏖️ Benefits

• Stock equity in the form of Restricted Stock Units (RSUs) to share in company success
• Up to 100% employer-paid premiums for medical, dental, and vision coverage for employees and dependents
• Comprehensive financial benefits including 401(k) plan, company-paid life and disability insurance, and tax-advantaged spending accounts
• Paid Parental Leave after six months of employment and access to Kindbody fertility and family-building benefits
• Generous annual stipends for professional and personal development
• Flexible vacation policy with paid holidays and remote flexibility on Mondays and Fridays

Skills & Technologies

Python

REST

Senior

Hybrid

$220k-298k

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Drata, Inc.

Visit Website

About Drata, Inc.

Drata is a compliance automation platform that continuously monitors and collects evidence for security frameworks such as SOC 2, ISO 27001, HIPAA, and PCI DSS. It integrates with cloud services, identity providers, and SaaS tools to track controls, manage risks, and generate audit-ready documentation. The company serves technology startups and enterprises seeking to streamline security compliance workflows and maintain continuous monitoring without manual spreadsheets.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.