Systems Engineer, HPC (US & Canada)

Mistral AI

Job Overview

Location

Montreal

Job Type

Full-time

Full Job Description

📋 Description

• Operate and maintain large-scale Linux environments across bare metal, cluster, and cloud infrastructure to support AI research and production workloads.
• Monitor system health, diagnose and resolve incidents, and ensure high availability of critical HPC and AI infrastructure.
• Scale infrastructure toward hundreds to thousands of nodes, optimizing for performance, reliability, and resource utilization in petabyte-scale storage environments.
• Automate operational tasks using Python, Bash, Ansible, and Terraform to improve deployment, provisioning, and system lifecycle management.
• Collaborate with HPC, infrastructure, DevOps, and research teams to bridge operational needs with technical requirements across distributed systems.
• Support production and research workloads simultaneously, ensuring stable and efficient execution of AI training and inference pipelines.
• Contribute to system design and architecture decisions for next-generation AI infrastructure, including storage, networking, and compute resource allocation.
• Troubleshoot complex issues spanning systems, hardware, and networks in high-throughput, low-latency environments.
• Work with job schedulers such as Slurm to manage workload distribution and resource allocation across large compute clusters.
• Improve system performance and efficiency by identifying bottlenecks and implementing targeted optimizations in HPC environments.
• Participate in on-call rotations to respond to critical infrastructure incidents and maintain service-level agreements for uptime and reliability.
• Document system configurations, operational procedures, and incident resolutions to ensure knowledge sharing and operational continuity.
• Engage in cross-functional planning with research teams to align infrastructure capabilities with evolving AI model requirements.
• Evaluate and integrate new technologies and tools to enhance automation, scalability, and operational resilience.
• Maintain strict operational discipline in environments where system failures directly impact costly AI training cycles.
• Act as a technical liaison between infrastructure teams and end-users, translating research needs into scalable system solutions.

🎯 Requirements

• Strong Linux systems administration experience (core requirement)
• Experience working in large-scale environments: HPC clusters or cloud infrastructure
• Experience with Job schedulers (e.g. Slurm)
• Solid troubleshooting skills across systems, hardware, and networks
• Experience with automation tooling (Python, Bash, Ansible, Terraform)
• Familiarity with storage systems (e.g. Ceph, Lustre, NFS) or networking fundamentals (Ethernet; InfiniBand preferred)

🏖️ Benefits

• Play a pivotal role in scaling Mistral’s cutting-edge AI infrastructure
• Opportunity to shape data centre operations from the ground up in a high-growth startup environment
• Work with a talented, cross-functional team passionate about AI and technology
• Competitive compensation and benefits
• Chance to contribute to revolutionary AI projects

Skills & Technologies

Python

Kubernetes

Terraform

Linux

Hybrid

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Mistral AI

Visit Website

About Mistral AI

Mistral AI is a Paris-based artificial intelligence company founded in 2023 that develops large language models and generative AI systems. The company creates open-source and commercial models optimized for performance, efficiency, and multilingual capabilities, serving enterprises and developers through APIs and cloud platforms. Its research focuses on advancing frontier AI while emphasizing safety, transparency, and European technological sovereignty.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.