Member of Engineering (Evaluations / Engineering)

📋 Description

• • As a Member of Engineering focused on Evaluations, you will design and implement a scalable self-serve evaluation platform that powers research and development at Poolside AI, enabling the team to build, run, and extract insights from evaluations efficiently.
• • Your day-to-day responsibilities include designing a Python framework for internal and public benchmarks, building and maintaining distributed evaluation pipelines, and collaborating with modeling and product teams to improve experimentation and tooling.
• • You will join a remote-first engineering team spread across EMEA and North America that values deep software engineering fundamentals, monthly in-person collaboration, and biannual offsites to foster innovation and cohesion.
• • In this role, you will gain experience in building production-grade ML infrastructure, shaping evaluation practices for frontier models, and working closely with researchers and engineers to accelerate AI development through robust tooling.