Staff Software Engineer, Trust & Safety

Replit, Inc.

Job Overview

Location

Foster City, CA

Job Type

Full-time

Full Job Description

📋 Description

• As a Staff Software Engineer on Replit's Trust & Safety team, you will defend the platform against exploitation by building detection systems and automated responses to abuse such as phishing, cryptomining, and LLM token farming.
• You will design and implement LLM guardrails, build AI-powered detection systems using LLMs to identify malicious patterns, and operate abuse detection systems that monitor millions of daily user actions for threats like account takeover and financial fraud.
• You will own the full abuse response lifecycle—from detection and investigation to enforcement and appeals—while collaborating with Support, Legal, and Engineering teams to adapt defenses as attack patterns evolve.
• Replit is the agentic software creation platform enabling anyone to build applications via natural language, democratizing software development for millions of users worldwide by removing traditional barriers to application creation.
• You will work on AI-native security challenges unique to Replit, such as detecting prompt injection attacks and using LLMs defensively, gaining hands-on experience applying AI to real-world security problems in production.
• You will analyze attack patterns using BigQuery and Hex, maintain internal tools like Slurper and Netwatch, and integrate security scanners (SAST, SCA) into CI pipelines with strict performance SLAs.
• This role offers the opportunity to grow as a technical leader in adversarial security, shaping how AI-generated code is safeguarded at scale while contributing to a mission-driven platform that empowers global creators.

🎯 Requirements

• 8+ years of experience in security engineering, anti-abuse, trust & safety, or fraud detection
• Strong programming skills in Python and/or TypeScript for building detection systems and automation
• Experience with SQL and data analysis at scale (BigQuery, Snowflake, or similar)
• Experience building or fine-tuning ML/LLM-based classifiers for security or abuse detection
• Familiarity with prompt injection, jailbreaking, and other LLM-specific attack vectors
• Ability to investigate complex abuse patterns and translate findings into automated defenses

🏖️ Benefits

• Competitive Salary & Equity
• 401(k) Program with a 4% match (US Only)
• Health, Dental, Vision and Life Insurance
• Short Term and Long Term Disability
• Paid Parental, Medical, Caregiver Leave
• Flexible Time Off (FTO) + Holidays
• Commuter Benefits (In-Office Only)
• Monthly Wellness Stipend
• Autonomous Work Environment
• In Office Set-Up Reimbursement (In-Office Only)
• Quarterly Team Gatherings
• In Office Amenities (In-Office Only)

Skills & Technologies

Python

TypeScript

GCP

Kubernetes

Linux

Senior

Onsite

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Replit, Inc.

Visit Website

About Replit, Inc.

Replit is an online, collaborative, integrated development environment (IDE) that allows users to write, run, and share code in numerous programming languages directly from their web browser. It provides a cloud-based platform, eliminating the need for local setup and dependencies. Replit supports real-time collaboration, enabling multiple users to code together simultaneously on the same project, making it ideal for educational purposes, team projects, and rapid prototyping. The platform offers a vast array of features including version control integration, package management, and deployment tools, democratizing software development for beginners and experienced programmers alike.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.