Senior Backend Software Engineer II, Orchestration

📋 Description

• • Join dbt Labs, the pioneering force behind analytics engineering and the leading platform for transforming raw data into reliable, actionable insights. With over 90,000 teams relying on our platform weekly for data transformations and AI use cases, and having surpassed $100 million in ARR, we are at the forefront of the modern data stack. We are backed by top-tier investors and driven by a belief in empowering data practitioners to leverage AI and deliver high-quality data faster, cheaper, and at scale.
• • As a Senior Backend Software Engineer II on the Orchestration team, you will play a pivotal role in owning and operating some of the most critical services at dbt Labs. This team is responsible for the job scheduling and execution engine that powers dbt Cloud, a system that must meet stringent uptime requirements and cater to the needs of large enterprise clients.
• • You will be instrumental in shaping the future of our orchestration system. This involves designing, implementing, and evolving reliable, secure, and highly available services. A significant part of your role will include refactoring legacy systems to align with our ambitious roadmap, working in close collaboration with our staff+ engineering group.
• • This position offers the opportunity to work with a diverse and complex technology stack. You will gain hands-on experience with a variety of programming languages and technologies, including Python, Rust, and Go, alongside databases like Postgres and Redis, container orchestration with Kubernetes, cloud infrastructure on AWS, infrastructure as code with Terraform, and robust monitoring solutions like Datadog.
• • Collaboration is key to our success. You will work closely with multiple engineering teams, product management, UX designers, and customer support to ensure our products meet user needs and technical requirements. This cross-functional interaction will provide a holistic view of product development and delivery.
• • As a Senior Engineer, you will serve as a mentor to junior engineers. You will guide them on best practices, architectural decisions, and problem-solving techniques, fostering a culture of continuous learning and technical excellence within the team.
• • A core aspect of this role is balancing the need for rapid delivery with the imperative of designing and implementing services that are inherently reliable, secure, and highly available. You will be expected to make sound technical judgments that uphold these principles.
• • You will leverage your extensive experience in designing microservices and event-driven architectures. Proficiency in developing robust APIs, including REST and gRPC, will be essential for building scalable and maintainable systems.
• • A strong understanding of observability principles and practical experience in debugging production issues at scale are crucial. You will be responsible for ensuring the health and performance of our critical services.
• • We are looking for individuals with a systematic problem-solving approach, excellent communication skills, and a strong sense of ownership and drive. You should be proactive in identifying and addressing challenges.
• • A passion for upholding engineering best practices throughout the Software Development Life Cycle (SDLC) is paramount. This includes a commitment to code quality, testing, and efficient development processes.
• • As a self-starter, you will be empowered to lead groups of engineers from the initial conception of ideas through to their successful implementation, driving innovation and technical direction.
• • This role is fully remote within the US, offering flexibility and the opportunity to work with a globally distributed team. You will need to be comfortable working asynchronously and collaborating effectively across different time zones.
• • While not strictly required, experience in the domain of data analytics and transformation will be a significant advantage, allowing you to quickly grasp the context and impact of your work on our users' data pipelines.
• • You will contribute to a fast-growing company that is defining the modern data stack and empowering data practitioners worldwide. Your work will directly impact the reliability and scalability of dbt Cloud, supporting critical AI and data engineering use cases for enterprise customers.