Senior Engineering Manager, Production Engineering

Harvey AI Inc.

Job Overview

Location

San Francisco

Job Type

Full-time

Full Job Description

📋 Description

• At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.
• This is a rare chance to help build a generational company at a true inflection point. With 1500+ customers in 60+ countries, strong product-market fit, and world-class investor support, we’re scaling fast and defining a new category in real time.
• Our team moves fast, takes ownership, and is deeply committed to the mission — operating with intensity, staying close to our customers, and pushing each other for excellence.
• We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are.
• If you want to do the best work of your career alongside people who share that drive, we’d love to build with you.
• Harvey is building the AI platform trusted by the world's leading law firms and enterprises. Our infrastructure is the foundation that powers every customer interaction, every model inference, and every production workload.
• We're looking for a Senior Engineering Manager to lead our Infrastructure Foundation & Production Quality Engineering organization. This team is responsible for building and operating Harvey's core compute and networking infrastructure, Kubernetes platform, workflow orchestration platform, and production infrastructure foundations that enable engineering teams to move quickly with confidence.
• In this role, you'll own the reliability, scalability, security, and efficiency of Harvey's infrastructure platform. You'll lead a team of high-performing engineers responsible for compute fleet management, capacity planning, infrastructure automation, and production operations.
• You'll partner closely with Product Engineering, Security, AI Infrastructure, and Platform teams to ensure our infrastructure scales with Harvey's rapid growth.
• You'll report to the Head of Infrastructure and play a key leadership role in shaping the future of Harvey's infrastructure platform.
• At Harvey, we value Decisiveness, Simplicity, and the belief that Job's Not Finished. We move quickly, prioritize clarity, and continuously raise the bar for engineering excellence.
• In this role, you'll:
• Lead, mentor, and grow a team of high-performing infrastructure engineers responsible for Harvey's production infrastructure foundation.
• Foster a culture of operational excellence, engineering quality, customer ownership, and continuous improvement.
• Partner with Engineering, Security, Product, and AI Infrastructure leaders to define long-term infrastructure strategy and execution priorities.
• Drive technical direction for compute infrastructure, networking, Kubernetes, workflow orchestration, and production operations.
• Lead cross-functional initiatives to improve reliability, scalability, security, operational efficiency, and infrastructure cost optimization.
• Own and operate Harvey's global compute and network infrastructure, ensuring high availability, scalability, reliability, and performance.
• Manage compute resources to maximize utilization, performance, and service availability while supporting rapidly growing AI workloads.
• Lead capacity planning, demand forecasting, and fleet lifecycle management to ensure infrastructure scales efficiently with business growth.
• Operate and continuously improve Harvey's Kubernetes platform, including cluster provisioning, upgrades, monitoring, reliability, performance, and operational automation.
• Own Harvey's Temporal-based workflow orchestration platform, ensuring reliable, scalable, and observable execution of distributed application workflows.
• Drive infrastructure cost optimization through capacity management, resource rightsizing, workload efficiency improvements, and utilization monitoring.
• Build and maintain secure infrastructure foundations, including identity and access management, network isolation, secrets management, auditing, and compliance controls.
• Develop scalable Infrastructure-as-Code and automation frameworks using technologies such as Terraform and Pulumi.
• Establish comprehensive observability, monitoring, alerting, incident response, and operational readiness practices across the infrastructure platform.
• You have:
• 7+ years of software or infrastructure engineering experience, including 5+ years leading engineering teams.
• Deep expertise operating large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform.
• Strong hands-on experience operating Kubernetes in production, including cluster lifecycle management, networking, and reliability.
• Experience building and operating large-scale distributed systems with strong reliability, scalability, and performance characteristics.
• Experience with infrastructure automation and Infrastructure-as-Code using tools such as Terraform or Pulumi.
• Strong understanding of compute infrastructure, networking, capacity planning, fleet management, and production operations.
• Experience designing and operating observability platforms, including monitoring, logging, alerting, and incident response processes.
• Strong understanding of infrastructure security, including IAM, network security, secrets management, and compliance best practices.
• Demonstrated success leading complex cross-functional technical initiatives and influencing engineering strategy across organizations.
• Excellent communication skills with the ability to communicate technical concepts clearly to both engineering and executive audiences.
• A systems-thinking mindset and passion for building simple, reliable, and scalable infrastructure platforms.
• Nice to Have:
• Experience operating workflow orchestration platforms such as Temporal.
• Experience supporting AI/ML or LLM infrastructure at scale.
• Experience managing GPU fleets, high-performance compute infrastructure, or large-scale capacity planning.
• Experience with multi-cloud infrastructure or hybrid cloud environments.

🎯 Requirements

• 7+ years of software or infrastructure engineering experience, including 5+ years leading engineering teams.
• Deep expertise operating large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform.
• Strong hands-on experience operating Kubernetes in production, including cluster lifecycle management, networking, and reliability.

🏖️ Benefits

• $272,000 - $355,000
• Excellent communication skills with the ability to communicate technical concepts clearly to both engineering and executive audiences.
• A systems-thinking mindset and passion for building simple, reliable, and scalable infrastructure platforms.
• Experience with infrastructure automation and Infrastructure-as-Code using tools such as Terraform or Pulumi.
• Strong understanding of compute infrastructure, networking, capacity planning, fleet management, and production operations.
• Experience designing and operating observability platforms, including monitoring, logging, alerting, and incident response processes.
• Strong understanding of infrastructure security, including IAM, network security, secrets management, and compliance best practices.
• Demonstrated success leading complex cross-functional technical initiatives and influencing engineering strategy across organizations.
• Excellent communication skills with the ability to communicate technical concepts clearly to both engineering and executive audiences.
• A systems-thinking mindset and passion for building simple, reliable, and scalable infrastructure platforms.

Skills & Technologies

AWS

Azure

GCP

Kubernetes

Terraform

Senior

Hybrid

$272k-355k

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Harvey AI Inc.

Visit Website

About Harvey AI Inc.

Harvey AI Inc. provides a generative artificial-intelligence platform engineered specifically for the legal profession. The software integrates with law-firm workflows to automate contract drafting, review, due-diligence and regulatory research, producing lawyer-quality language grounded in up-to-date statutes and precedents. Harvey combines large language models trained on legal corpora with secure, private-cloud deployment and firm-specific fine-tuning to maintain confidentiality and compliance. Clients range from global law firms to in-house legal departments seeking efficiency gains without compromising accuracy or security. The company was founded in 2022 and is headquartered in San Francisco, California.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.