Sr. Machine Learning Developer

📋 Description

• • Join Autodesk’s AEC Design organization as a Sr. Machine Learning Developer, a pivotal role focused on building, evaluating, and scaling the next generation of AI-powered and agentic experiences. You will be instrumental in shaping future MCP-based workflows, contributing directly to the innovation pipeline that drives the future of design and construction technology.
• • This position offers a unique opportunity to collaborate closely with a multidisciplinary team, including senior Data Scientists, experienced Software Engineers, and dedicated product teams. Your work will directly impact the development of reliable Machine Learning models, the critical evaluation of Large Language Model (LLM) driven tool-calling capabilities, and the enhancement of unified LLM evaluation frameworks that will be adopted across the entire Architecture, Engineering, and Construction (AEC) sector.
• • The role is ideally suited for an early-career engineer who possesses strong foundational knowledge in Machine Learning, a genuine curiosity for emerging AI technologies, and the adaptability to thrive in both experimental and production engineering environments. You will be at the forefront of applying cutting-edge AI to solve complex industry challenges.
• • Your core responsibilities will encompass the development and rigorous evaluation of various ML models, including but not limited to classification, regression, clustering, and forecasting algorithms. This hands-on development will be crucial for identifying patterns, predicting outcomes, and optimizing processes within AEC workflows.
• • A significant part of your role will involve supporting and advancing LLM evaluation workflows. This includes the meticulous creation of high-quality datasets, the definition and application of relevant metrics, and comprehensive benchmarking specifically for MCP (Model-Centric Platform) and Assistant scenarios. Your insights will guide the refinement of LLM performance and utility.
• • You will be tasked with running offline batch evaluations to assess model performance in controlled environments and will actively contribute to the instrumentation of real-time evaluation systems. This may involve working with tools and custom pipelines such as Opik, Langfuse, or developing new solutions to capture live performance data.
• • Collaboration with our engineering teams is key. You will work to seamlessly integrate developed ML models into production workflows, ensuring adherence to best practices in Continuous Integration and Continuous Deployment (CI/CD) to maintain efficiency and reliability.
• • To streamline operations and enhance productivity, you will build essential scripts, utilities, and small-scale pipelines. These tools will automate critical tasks such as data preparation, experiment execution, and the evaluation process, freeing up valuable time for more complex analytical work.
• • You will partner effectively with Product Managers (PMs), domain experts, and cross-product teams. This collaboration is vital for translating complex user scenarios and business needs into clearly defined, measurable evaluation tasks, ensuring that our AI solutions directly address real-world problems.
• • This role provides a direct pathway to influence the future of AEC design by working on cutting-edge ML and LLM technologies. You will contribute to significant cross-product AI initiatives, including projects like Tyto, AA (Agentic Accelerator), MCP, and other strategic AI programs.
• • You will have the invaluable opportunity to learn from and collaborate with a team of highly experienced scientists, engineers, and product professionals, fostering professional growth and knowledge sharing.
• • Autodesk offers clear growth opportunities, providing exposure across multiple strategic AI programs and encouraging career advancement within the company.
• • The company is committed to building a better world through innovative design and technology, and this role is central to that mission.