Staff Software Engineer, Core Infrastructure

Harvey AI Inc.

Job Overview

Location

Bengaluru

Job Type

Full-time

Full Job Description

📋 Description

• As a Staff Software Engineer on the Core Infrastructure team at Harvey AI Inc., you will play a critical role in designing and building new infrastructure systems while scaling and strengthening existing infrastructure that powers every user interaction with Harvey’s AI platform, processing billions of prompt tokens and millions of daily requests across global legal AI services.
• This role is pivotal in ensuring the reliability, scalability, and security of Harvey’s platform as it serves leading law firms and professional service providers worldwide, directly impacting the foundation that enables the company’s mission to transform legal and professional services through frontier agentic AI.
• You will design and build scalable, fault-tolerant infrastructure systems that power Harvey's AI platform across multiple cloud regions, ensuring high availability and performance under massive workloads.
• You will own and evolve Harvey’s multi-cloud infrastructure (Azure, GCP), including Kubernetes orchestration, networking, and container management, driving consistency, efficiency, and resilience across environments.
• You will lead technical initiatives around observability, incident response, and operational excellence — building systems that enable rapid detection, diagnosis, and resolution of issues to maintain platform stability and user trust.
• You will architect and optimize distributed systems for reliability, including load balancing, quota management, and failover mechanisms, ensuring seamless performance during traffic spikes and regional failures.
• You will partner with Product Engineering and Security teams to ensure infrastructure acts as an accelerant, not a constraint, enabling faster innovation without compromising security or compliance.
• You will drive infrastructure-as-code practices using tools like Terraform and Pulumi to enable reproducible, auditable, and version-controlled deployments across all environments.
• You will mentor engineers and raise the technical bar across the organization through code reviews, design reviews, and technical leadership, fostering a culture of excellence and knowledge sharing.
• Representative projects include designing a next-generation model proxy architecture for millions of daily inference requests, building distributed rate limiting and quota management systems using Redis-backed algorithms, architecting multi-region deployment strategies for data residency compliance, developing observability infrastructure with SLA monitoring and token attribution, and leading CI/CD pipeline evolution to improve developer velocity while maintaining production stability.
• About the team or company: Harvey AI Inc. is transforming legal and professional services through end-to-end AI innovation, serving 1000+ customers in 60+ countries with strong product-market fit and world-class investor backing, operating at a true inflection point where ambition, intensity, and ownership define the culture.
• What the person can learn or achieve in this role: You will gain deep expertise in scaling AI-native infrastructure at global scale, shape the technical foundation of a generational company, and grow as a technical leader influencing cross-functional teams while solving some of the most complex infrastructure challenges in enterprise AI.

🎯 Requirements

• 8+ years of experience in Infrastructure Engineering or Platform Engineering in a production environment
• Long track record building and scaling complex, large-scale distributed systems
• Deep proficiency with cloud infrastructure platforms (Azure preferred; GCP or AWS experience transfers well)
• Strong fluency in Infrastructure as Code (IaC) tools — Terraform, Pulumi, or CloudFormation
• Solid understanding of Kubernetes, container orchestration, networking, and cloud security at scale
• Experience with observability tools (Datadog, Sentry) and incident response practices (PagerDuty, Incident.io)
• Strong programming skills in Python, Go, or similar languages
• Excellent problem-solving skills, a 'spidey sense' of where things could go wrong, and a commitment to operational excellence

🏖️ Benefits

• Opportunity to help build a generational company at a true inflection point with unmatched growth potential — personal, professional, and financial
• Work with a sharp, motivated, and deeply committed team that operates with intensity, ownership, and customer obsession
• Solve real problems with urgency and care alongside leadership and engineers who stay close to customers across 60+ countries
• Thrive in an environment that values ambiguity, excellence, and the chance to shape the future of work
• Be part of a company transforming legal and professional services through frontier agentic AI and enterprise-grade platform innovation
• Work based in Bengaluru, India, with no visa sponsorship required — must be authorized to work in India

Skills & Technologies

Python

Redis

AWS

Azure

DevOps

Senior

Onsite

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Harvey AI Inc.

Visit Website

About Harvey AI Inc.

Harvey AI Inc. provides a generative artificial-intelligence platform engineered specifically for the legal profession. The software integrates with law-firm workflows to automate contract drafting, review, due-diligence and regulatory research, producing lawyer-quality language grounded in up-to-date statutes and precedents. Harvey combines large language models trained on legal corpora with secure, private-cloud deployment and firm-specific fine-tuning to maintain confidentiality and compliance. Clients range from global law firms to in-house legal departments seeking efficiency gains without compromising accuracy or security. The company was founded in 2022 and is headquartered in San Francisco, California.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.