Distributed Systems Engineer, Data & Inference Platform

Adaption Inc.

Job Overview

Location

San Francisco

Job Type

Full-time

Full Job Description

📋 Description

• As a Distributed Systems Engineer on Adaption Inc.'s Data & Inference Platform team, you will build and operate the foundational systems that transform raw compute into usable intelligence by scaling LLM inference services and designing robust data pipelines that support real-time AI evolution.
• Day to day, you will design and optimize distributed inference systems for LLMs across heterogeneous GPU fleets, develop large-scale data pipelines using Ray Data or Spark to handle petabyte-scale workloads, diagnose and resolve elusive production issues like stragglers and GPU memory fragmentation, and collaborate directly with researchers to transition experimental ML workloads into reliable, efficient production systems.
• Adaption Inc. is building efficient, adaptive intelligence that evolves in real-time, driven by a talent-dense team of builders committed to making AI flexible, personalized, and accessible through systemic efficiency and innovation.
• In this role, you will deepen your expertise in distributed systems at the intersection of ML infrastructure and high-performance computing, gain hands-on experience with cutting-edge LLM serving engines and lakehouse technologies, and own critical production systems that directly impact the scalability and cost-efficiency of AI workloads.

🎯 Requirements

• 5+ years building and operating distributed systems in production
• Deep experience with at least one large-scale data or compute framework (Ray, Spark, Flink, Beam, Dask)
• Strong fluency in Python and at least one systems language (Go, Rust, C++)
• Working knowledge of the GPU/accelerator stack: CUDA fundamentals, NCCL, mixed precision, memory layout
• Experience operating Kubernetes-based infrastructure, including custom operators or schedulers
• A track record of owning hard production incidents end-to-end — diagnosis, mitigation, and the durable fix

🏖️ Benefits

• Flexible work: In-person collaboration in the Bay Area, a distributed global-first team, and team offsites
• Adaption Passport: Annual travel stipend to explore a country you've never visited
• Lunch Stipend: Weekly meal allowance for take-out or grocery delivery
• Well-Being: Comprehensive medical benefits and generous paid time off

Skills & Technologies

Python

Rust

Node.js

Kubernetes

Onsite

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Adaption Inc.

Visit Website

About Adaption Inc.

Adaption is a company focused on revolutionizing the way businesses manage their digital assets and workflows. They provide a comprehensive platform designed to streamline content creation, collaboration, and distribution processes. Their solution caters to various industries, enabling organizations to enhance efficiency, reduce operational costs, and improve overall productivity. By leveraging advanced technology, Adaption empowers teams to work more cohesively and deliver high-quality digital experiences. The company's core mission is to simplify complex digital operations, making them accessible and manageable for businesses of all sizes.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.