Research Engineer - AI Systems

Yotta Savings, Inc.

Job Overview

Location

United States

Job Type

Full-time

Full Job Description

📋 Description

• Design and implement high-performance kernels for Attention, MoE, GEMM, collective communication, and quantization operations across heterogeneous AI accelerators.
• Optimize custom kernels for NVIDIA GPUs, AMD GPUs, and AWS Trainium to maximize throughput and minimize latency in AI training and inference workloads.
• Develop custom operators and graph optimizations using Neuron SDK, PyTorch/XLA, Torch Dynamo, and Neuron Compiler to enhance model execution efficiency.
• Improve performance of inference runtimes including vLLM, SGLang, and TensorRT-LLM through low-level system-level tuning and memory management.
• Architect scalable distributed training and inference systems capable of operating across thousands of accelerators in multi-silicon environments.
• Contribute to open-source AI infrastructure projects by submitting code, fixing bugs, and documenting optimizations for community adoption.
• Publish technical findings and research outcomes in peer-reviewed venues or through public technical blogs to advance the state of AI systems.
• Collaborate with cross-functional teams to integrate optimized kernels and runtime components into Yotta Labs’ multi-silicon AI cloud platform.
• Profile and analyze performance bottlenecks using Nsight, ROCm Profiler, and Neuron Profiler to guide targeted optimizations.
• Work closely with research and engineering teams to translate theoretical AI model architectures into efficient, production-ready system implementations.
• Maintain and extend custom inference runtimes to support emerging LLM architectures and quantization techniques.
• Engage with the global AI developer community through forums, conferences, and open-source contributions to gather feedback and share best practices.
• Participate in code reviews, technical design discussions, and sprint planning in a fully remote, asynchronous work environment.
• Document system architectures, kernel APIs, and performance benchmarks for internal and external stakeholders.
• Stay current with advancements in AI hardware, compilers, and frameworks to identify opportunities for performance gains on new accelerator platforms.

🎯 Requirements

• Proficiency in AI programming languages such as Python and C++.
• Deep understanding of GPU architecture and performance optimization.
• Experience with CUDA, Triton, ROCm/HIP, or AWS Neuron.
• Strong understanding of AI frameworks (e.g., PyTorch, Dynamo, LMCache), model architectures and profiling tools (e.g. Nsight, ROCm Profiler, or Neuron Profiler).
• Strong problem-solving skills and the ability to work in a collaborative, remote environment.
• A background in computer science, engineering, or a related field is preferred.

🏖️ Benefits

• Competitive compensation with equity.
• Flexible, remote work environment that values innovation and autonomy.
• Opportunity to work on cutting-edge technologies that solve frontier AI infrastructure problems.
• Collaboration with experts from leading institutions and tech companies.
• Be part of a visionary team aiming to redefine AI infrastructure and influence the future of multi-silicon AI computing.

Skills & Technologies

Python

AWS

PyTorch

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Yotta Savings, Inc.

Visit Website

About Yotta Savings, Inc.

Yotta Savings, Inc. operates an FDIC-insured online savings platform that awards daily cash prizes through randomized drawings instead of traditional interest. Deposits held at partner banks compete for weekly and monthly jackpots funded by the banks’ interest revenue. Users earn tickets proportional to balances, with additional tickets for referrals and debit-card spending, while maintaining full liquidity and no fees.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.