Senior Data Engineer (Databricks, SQL)

📋 Description

• • Embark on a pivotal role as a Senior Data Engineer at Exadel, where you will be instrumental in shaping the future of data infrastructure for a leading health and fitness software and payment processing provider. This is a unique opportunity to leverage your expertise in Databricks, SQL, and cloud technologies to drive significant improvements in data processing, analytics, and business intelligence.
• • You will be at the forefront of designing and implementing robust, scalable data pipelines and sophisticated lakehouse architectures, utilizing the power of Databricks, including Spark and Delta Lake. Your contributions will directly impact the efficiency and effectiveness of data-driven decision-making for a client that serves over 7,000 health clubs across North America.
• • A key responsibility will be to lead and execute a critical migration project from Azure Synapse to Databricks. This initiative demands meticulous planning and execution to ensure enhanced performance, optimized costs, and improved reliability of the data platform. Your success in this migration will lay the groundwork for future data innovations.
• • You will be tasked with developing and optimizing Databricks SQL Warehouses, ensuring they are finely tuned to support demanding analytics and business intelligence workloads. This involves understanding the intricacies of query performance and resource management within the Databricks environment.
• • Building and maintaining comprehensive semantic models will be a core part of your role. These models are essential for enabling enterprise-wide reporting and empowering self-service analytics capabilities for various business stakeholders. Your work will ensure that data is accessible, understandable, and actionable.
• • Collaboration is key. You will partner closely with analytics and business teams to deliver high-quality Power BI datasets and insightful dashboards. This involves translating business requirements into effective data solutions and ensuring the accuracy and usability of the final reports.
• • Your advanced SQL skills will be put to the test as you write, optimize, and tune complex SQL queries designed to handle large-scale analytical workloads. This includes identifying performance bottlenecks and implementing efficient query strategies.
• • A strong emphasis will be placed on ensuring the highest standards of data quality, reliability, and governance across the entire analytics platform. You will be responsible for implementing checks and balances to maintain data integrity and trustworthiness.
• • You will actively contribute to critical architecture decisions, helping to define and uphold best practices and standards for data engineering within the organization. Your insights and experience will guide the evolution of the data landscape.
• • This role offers the chance to work with a cutting-edge tech stack, including Databricks (Spark, Delta Lake, SQL Warehouses), Azure Synapse, Azure SQL, and Power BI (DAX, semantic modeling, RLS). Your expertise in these technologies will be highly valued and further developed.
• • Beyond the technical aspects, you will be part of Exadel, a global tech company with a rich history of engineering leadership and a commitment to fostering a collaborative and evolving work environment. You'll contribute to projects for Fortune 500 clients, gaining exposure to diverse and challenging business problems.
• • The client is a well-established player in the health and fitness industry, providing essential software and payment processing solutions. Your work will directly support their mission to help health clubs operate more efficiently and effectively.
• • You will be expected to maintain an Upper-Intermediate level of English proficiency to facilitate seamless communication within international project teams.
• • Exadel champions diversity and inclusion, offering a supportive environment where all individuals are valued and respected. You will be part of a company that prioritizes reasonable accommodations and equal opportunities.
• • This role is ideal for a seasoned data professional who thrives on complex challenges, enjoys optimizing data systems, and is passionate about enabling data-driven insights. You will have the autonomy to make significant technical contributions while working within a supportive and forward-thinking team.
• • Your impact will extend to improving the operational efficiency of thousands of health clubs by ensuring their data systems are robust, performant, and insightful. This is an opportunity to make a tangible difference in a dynamic industry.