Software Engineer AI Gateway

Kong Inc.

Job Overview

Location

Italy-Milan

Job Type

Full-time

Full Job Description

📋 Description

• As a Software Engineer on the AI Gateway team at Kong Inc., you will build and maintain core features of the Kong AI Gateway, including multi-LLM routing, semantic caching, and proxying capabilities, enabling developers worldwide to govern AI and LLM-based innovation.
• Day to day, you will implement new features like load balancing and database support, troubleshoot bugs, tune performance, optimize low-level systems, and bridge Kong with third-party deployment platforms and tooling.
• You will join Kong’s engineering team, which builds the unified API and AI platform Kong Konnect, trusted by Fortune 500 companies and startups to secure, manage, and monetize intelligence across APIs and AI models.
• In this role, you will deepen your expertise in distributed systems, Linux networking, and high-performance backend development while contributing to cutting-edge AI infrastructure and gaining experience in AI gateway technologies.

🎯 Requirements

• 3+ years of programming in server-side applications and components
• Hands on experience with either Golang or Rust
• Experience building and debugging highly scalable, distributed, reliable, and resilient applications
• Solid hands-on low-level technical expertise in Linux systems troubleshooting and profiling
• Experience in distributed systems, Linux networking stack, and computer systems programming
• Comfortable working with a remotely distributed team
• Strong sense of ownership and excellent verbal and written communication skills
• Familiarity with AI LLM concepts and applications development

🏖️ Benefits

• Opportunity to work on core AI gateway features like multi-LLM routing and semantic caching
• Contribute to Kong Konnect, a unified API and AI platform used by Fortune 500 and startups
• Work with cutting-edge technologies in API management, AI connectivity, and distributed systems
• Collaborate with a globally distributed engineering team
• Deepen expertise in Linux systems, networking, and high-performance backend development
• Build documentation and shape product direction through strong communication and ownership

Skills & Technologies

Rust

Linux

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Kong Inc.

Visit Website

About Kong Inc.

Kong Inc. is a San Francisco-based software company that develops an open-source API gateway and service connectivity platform. The company offers Kong Gateway, Kong Mesh, and Konnect cloud services to manage, secure, and observe microservices and APIs across clouds and data centers. Founded in 2007 as Mashape, it rebranded to Kong in 2017. Kong’s technology provides traffic control, authentication, rate limiting, and analytics for modern distributed architectures, supporting organizations in digital transformation and cloud-native adoption.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.