Job Overview
Location
San Francisco
Job Type
Full-time
Category
Backend Engineer
Date Posted
March 18, 2026
Full Job Description
đź“‹ Description
- • As a Software Engineer on the Ray Core team at Anyscale, you will contribute to the foundational infrastructure that powers scalable machine learning and distributed computing for industry leaders like OpenAI, Uber, and Spotify, enabling developers to scale applications from laptop to cluster without deep distributed systems expertise.
- • Your work will directly impact the reliability, performance, and usability of Ray, an open-source framework driving innovation in AI and large-scale data processing across some of the world’s most advanced technology companies.
- • Day to day, you will develop high-quality open-source C++ software to enhance Ray’s distributed scheduler, language runtime integration, I/O, and memory subsystems, focusing on correctness, scalability, and fault tolerance.
- • You will identify, implement, and evaluate architectural improvements to Ray’s core systems, including optimizations for large-scale workloads, enhancements to fault tolerance (HA), and refinements to stress and stability testing infrastructure.
- • You will improve the testing and release processes for Ray to ensure smooth, reliable deployments, working closely with the team to strengthen test automation, benchmarking, and regression detection.
- • You will collaborate with cross-functional teams to support higher-level libraries and use cases, ensuring Ray provides the right abstractions and performance characteristics for machine learning, data engineering, and other distributed applications.
- • You will communicate your technical contributions through internal knowledge sharing, tech talks, tutorials, and blog posts, helping to grow the Ray ecosystem and educate both internal and external audiences.
- • You will engage with the open-source community by reviewing contributions, responding to issues, and helping maintain Ray’s reputation as a reliable, production-grade distributed computing platform.
- • You will work in a collaborative, intellectually rigorous environment where systems thinking, clean code, and performance optimization are valued, and where your contributions have measurable impact on a widely adopted open-source project.
- • You will have the opportunity to deepen your expertise in distributed systems, C++ performance tuning, concurrent programming, and large-scale system design while working on cutting-edge challenges in scalable AI infrastructure.
🎯 Requirements
- • At least 2 years of relevant work experience in software engineering, with a focus on systems or distributed systems development.
- • Solid background in algorithms, data structures, and system design, demonstrated through academic or professional work.
- • Experience building scalable and fault-tolerant distributed systems, including familiarity with concepts such as consensus, replication, load balancing, and failure recovery.
🏖️ Benefits
- • Competitive salary and equity compensation as part of a well-funded startup backed by Andreessen Horowitz, NEA, and Addition, with over $250 million raised to date.
- • Comprehensive health, dental, and vision insurance plans, along with mental health resources and wellness programs to support employee well-being.
- • Flexible work arrangements and a supportive culture that values work-life balance, continuous learning, and innovation in a mission-driven environment.
Skills & Technologies
About Anyscale Inc.
Anyscale Inc. builds the Ray open-source distributed computing framework and offers a managed platform that lets data scientists and engineers scale machine-learning workloads from laptop to cloud without rewriting code. The company provides serverless infrastructure, observability, and cluster automation so teams can train, tune, and serve models faster. Founded in 2019 by the creators of Ray at UC Berkeley, Anyscale serves Fortune 500 enterprises and AI startups, enabling them to reduce cost and complexity while accelerating production deployment of large-scale AI applications.
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
Similar Opportunities
2 days ago
Silver.com LLC
1 month ago