Senior Software Engineer- Data Engineering

📋 Description

• • Join Cloudera, a leader in empowering organizations to transform complex data into clear and actionable insights. We are the preferred data partner for top companies across nearly every industry, leveraging the relentless innovation of the open-source community to drive digital transformation for the world's largest enterprises.
• • As a Senior Software Engineer within our Data Services Pillar, you will be at the forefront of data innovation, contributing to the creation of seamless, enterprise-grade experiences for data engineering, warehousing, streaming, operational databases, and AI.
• • This role specifically focuses on Cloudera Data Engineering, our next-generation cloud-native service designed to simplify large-scale data engineering workflows. You will work with industry-standard big data processing frameworks such as Apache Spark and Apache Airflow, deploying them seamlessly across both on-premises and public cloud environments.
• • You will take a lead role in shaping the future of Cloudera's Data Engineering experience, with a particular emphasis on customers utilizing Cloudera Data Engineering Spark with Iceberg. This is a high-impact individual contributor position with the potential to influence thousands of customers globally.
• • Dive deep into the Cloudera Data Engineering technical stack, gaining profound knowledge of runtimes like Apache Spark and Apache Iceberg, and apply this expertise to solve complex challenges.
• • Collaborate within a team of highly skilled infrastructure engineers, contributing to hiring efforts, mentoring junior engineers, and actively supporting their professional development and career growth.
• • Drive critical architecture and design discussions, providing strong technical leadership and direction to the engineering team, ensuring robust and scalable solutions.
• • Partner effectively with product management, fellow engineering teams, and cross-functional stakeholders to lead the successful delivery of significant and critical features within Cloudera's data engineering offerings.
• • Engage with large-scale distributed systems, working with infrastructure that ranges from hundreds to thousands of nodes in production clusters, ensuring reliability and performance.
• • Bring a genuine passion for programming, adhering to clean coding practices, demonstrating meticulous attention to detail, and maintaining an unwavering focus on delivering high-quality software.
• • Contribute to building cloud-native solutions that are deployable anywhere, from massive clusters on any cloud provider to private data centers, utilizing cutting-edge technologies like Trino, Spark, and Airflow.
• • Play a key role in advancing AI inferencing systems and shaping the future of analytics, ensuring our code directly empowers data engineers, analysts, and developers worldwide to extract maximum value from their data.
• • Embrace the power of open source by collaborating with project committers and contributing upstream to the evolution of technologies such as Apache Spark and Iceberg.
• • Harden these critical open-source engines for robust security, optimize them for peak performance, and ensure they run effortlessly across diverse environments.
• • Join us to help build the trusted, cloud-native platform that powers insights for the most data-intensive companies on the planet, making a tangible impact on global data strategies.
• • This role offers a unique opportunity to work with a world-class team on challenging problems in the big data and cloud-native space, fostering innovation and continuous learning.