Senior Software Engineer (YDB Team)

📋 Description

• • **Pivotal Role in Advancing Cloud Infrastructure for AI:** As a Senior Software Engineer on the YDB Team at Nebius, you will play a critical role in developing and optimizing YDB, an open-source, high-performance distributed storage and database system. This foundational technology powers Nebius’s cloud infrastructure, including S3 Object Storage, Filestore, and critical cloud operations like IAM, Billing, and Audit Trails. Your work will directly enable scalable, reliable, and low-latency solutions for AI workloads, ensuring Nebius remains at the forefront of the global AI economy.
• • **Day-to-Day Responsibilities:**
• • **Optimize YDB for Modern Hardware:** Adapt YDB to fully leverage cutting-edge hardware, including QLC NVMe drives, Dual 800Gb/s network adapters, and BlueField DPUs. This involves deep performance tuning to maximize efficiency and throughput, ensuring the system can handle the demands of AI-related workloads.
• • **Enhance Performance on Standard Devices:** Improve YDB’s performance on widely used storage devices such as HDDs and TLC NVMe. This includes refining algorithms, reducing latency, and optimizing resource utilization to deliver consistent, high-performance results across diverse hardware configurations.
• • **Reengineer Core Components:** Redesign and implement more efficient algorithms within YDB to address complex system challenges. This may involve overhauling data structures, improving concurrency models, or enhancing fault tolerance to ensure scalability and reliability.
• • **Debug and Profile High-Load Systems:** Utilize advanced debugging and profiling tools (e.g., perf, VTune, bpftrace, gdb) to identify bottlenecks, analyze core dumps, and generate flamegraphs. Your expertise will be critical in diagnosing and resolving performance issues in highly loaded, low-latency environments.
• • **Collaborate on Distributed Systems:** Work closely with cross-functional teams to design and implement production-grade distributed storage components. This includes contributing to the development of on-disk data structures (e.g., LSM trees, B+ trees), erasure coding, checksumming, and other storage-related algorithms.
• • **Incident Resolution and System Reliability:** Actively participate in incident resolution, ensuring the durability and availability of YDB. Apply knowledge of availability and durability calculations to minimize downtime and maintain system integrity under high load.
• • **About Nebius:** Nebius is a trailblazer in cloud infrastructure for the AI economy, offering a full-stack AI cloud platform that supports developers and enterprises from data/model training to production deployment. Headquartered in Amsterdam and listed on Nasdaq (NBIS), Nebius boasts a global footprint with R&D hubs across Europe, the UK, North America, and Israel. The company’s 1,500+ employees include hundreds of engineers with deep expertise in hardware, software, and AI R&D, making it a dynamic and innovative environment for technical growth.
• • **What You Can Learn and Achieve:**
• • **Mastery of High-Performance Systems:** Gain deep expertise in developing and optimizing high-performance, low-latency distributed systems. You’ll work with cutting-edge hardware and software technologies, honing skills that are highly valued in the tech industry.
• • **Impact on AI and Cloud Infrastructure:** Contribute to projects that shape the future of AI and cloud computing. Your work on YDB will directly support Nebius’s mission to provide scalable, reliable infrastructure for AI workloads, giving you the opportunity to make a tangible impact on the global AI economy.
• • **Career Growth and Innovation:** Nebius offers a collaborative and innovative culture where engineers are encouraged to take ownership of their work. With opportunities for career growth, learning, and leadership, this role is ideal for those looking to advance their technical expertise while working on meaningful, high-impact projects.