Software Engineer, Platform Infrastructure (Foundations)

Anyscale Inc.

Job Overview

Location

San Francisco or Palo Alto, CA

Job Type

Full-time

Full Job Description

📋 Description

• As a Software Engineer on the Platform Infrastructure (Foundations) team at Anyscale, you will help build the scalable, secure, and robust backbone that enables developers to run distributed AI applications from laptop to cloud without needing deep distributed systems expertise.
• Day to day, you will design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments, optimize control plane components for large-scale AI/ML workloads, build intelligent scheduling and resource management systems, and enhance reliability, performance, scalability, and observability of Anyscale-managed Ray workloads.
• You will join a team responsible for both the control plane (orchestrating cluster management, scheduling, and user access) and data plane (ensuring high-performance execution of distributed workloads), working alongside leading distributed systems and machine learning experts.
• In this role, you will have the opportunity to contribute to open-source Ray, develop features for Anyscale’s proprietary platform, optimize accelerator integration (GPUs, TPUs), handle container image management, and grow your expertise in cloud-native infrastructure while solving real-world challenges in AI scalability.

🎯 Requirements

• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
• 3+ years of experience writing high-quality production code
• Hands-on experience in building and maintaining highly available, scalable, and performant distributed systems
• Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments
• Proficiency in Go and Python
• Knowledge of low-level operating system foundations (Linux kernel, file systems, containers)

🏖️ Benefits

• Opportunity to work on open-source Ray and contribute to Anyscale’s proprietary platform
• Collaborate with leading distributed systems and machine learning experts
• Work on high-impact features used by companies like OpenAI, Uber, Spotify, and Instacart
• Backed by top-tier investors (Andreessen Horowitz, NEA, Addition) with $250M+ raised
• Equal Opportunity Employer with commitment to inclusive hiring
• E-Verify participation and transparent right-to-work documentation

Skills & Technologies

Python

AWS

Azure

GCP

DevOps

Onsite

Degree Required

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Anyscale Inc.

Visit Website

About Anyscale Inc.

Anyscale Inc. builds the Ray open-source distributed computing framework and offers a managed platform that lets data scientists and engineers scale machine-learning workloads from laptop to cloud without rewriting code. The company provides serverless infrastructure, observability, and cluster automation so teams can train, tune, and serve models faster. Founded in 2019 by the creators of Ray at UC Berkeley, Anyscale serves Fortune 500 enterprises and AI startups, enabling them to reduce cost and complexity while accelerating production deployment of large-scale AI applications.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.