Senior Data Engineer (Databricks, SQL)

📋 Description

• • Embark on a pivotal role as a Senior Data Engineer, joining a dynamic global tech company with over 25 years of engineering excellence and a robust team of 2,000+ professionals. You will be instrumental in shaping the future of data infrastructure for a leading health and fitness software and payment processing provider, serving thousands of health clubs across North America. This is an exceptional opportunity to leverage cutting-edge technologies and contribute to a company that has been at the forefront of its industry since 1981, empowering businesses with innovative management and payment solutions.
• • In this senior capacity, you will be tasked with the end-to-end design, development, and implementation of highly scalable data pipelines and sophisticated lakehouse architectures. Your expertise will be crucial in harnessing the power of Databricks, specifically utilizing Spark and Delta Lake, to build robust and efficient data solutions. You will play a lead role in a significant technical undertaking: migrating the existing data platform from Azure Synapse to Databricks. This migration is not merely a technical shift but a strategic move aimed at achieving substantial improvements in performance, cost-efficiency, and overall reliability of the data infrastructure.
• • A key responsibility will involve the development and meticulous optimization of Databricks SQL Warehouses. These warehouses will serve as the backbone for critical analytics and business intelligence workloads, ensuring that stakeholders have access to timely and accurate data for decision-making. You will be responsible for building and maintaining comprehensive semantic models, employing best practices such as star schemas, to facilitate enterprise-wide reporting and empower self-service analytics capabilities for business users. This involves translating complex data structures into understandable and actionable insights.
• • Collaboration is at the heart of this role. You will work closely with analytics and business teams to deliver high-quality Power BI datasets and interactive dashboards. This partnership ensures that the data solutions directly address business needs and provide clear, insightful visualizations. Your advanced SQL skills will be put to the test as you write, optimize, and tune complex SQL queries designed to handle large-scale analytical workloads efficiently. This includes deep dives into query performance, indexing strategies, and data partitioning to ensure optimal execution times.
• • Beyond development, you will be a guardian of data integrity. Ensuring data quality, reliability, and adherence to governance standards across the entire analytics platform will be paramount. This involves implementing validation checks, monitoring data flows, and establishing clear data lineage. Furthermore, you will actively contribute to strategic architectural decisions, championing data engineering best practices, and establishing robust standards for the team and the organization. Your insights will help shape the future direction of the company's data strategy.
• • This role offers the chance to work with a modern tech stack, including Databricks (Spark, Delta Lake, SQL Warehouses), Azure Synapse, Azure SQL, and Power BI (DAX, semantic modeling, RLS). You will be instrumental in driving innovation and ensuring that the data platform remains a competitive advantage for the client, supporting their mission to provide seamless health club management and payment processing solutions.
• • The ideal candidate will possess a strong analytical mindset, a passion for building scalable data solutions, and a collaborative spirit. You will thrive in an environment that values continuous learning and technical excellence, contributing to a culture of trust, respect, and purpose. Your work will directly impact the operational efficiency and strategic growth of a well-established leader in the health and fitness technology sector.