Senior Data Engineer (Databricks, SQL)

📋 Description

• • Embark on a pivotal role as a Senior Data Engineer, joining a dynamic team at Exadel, a globally recognized AI-first tech company with over 25 years of engineering excellence. You will be instrumental in shaping the future of data infrastructure for a leading health and fitness software and payment processing provider. This is an exceptional opportunity to leverage cutting-edge technologies like Databricks, Azure Synapse, and Power BI to drive significant improvements in data management, analytics, and business intelligence for a client that serves over 7,000 health clubs.
• • As a Senior Data Engineer, your primary responsibility will be to design, develop, and implement robust, scalable data pipelines and sophisticated lakehouse architectures. You will be at the forefront of a critical migration initiative, transitioning the client's data platform from Azure Synapse to Databricks. This migration is not just a technical shift but a strategic move aimed at enhancing performance, optimizing costs, and ensuring unparalleled reliability for their data operations.
• • Your expertise will be crucial in building and maintaining high-performance Databricks SQL Warehouses, specifically tailored to support demanding analytics and business intelligence workloads. You will be responsible for developing and refining semantic models that serve as the foundation for enterprise-wide reporting and empower self-service analytics capabilities across the organization. This involves translating complex business requirements into well-structured, efficient data models.
• • Collaboration is key in this role. You will work closely with analytics and business intelligence teams to deliver high-quality Power BI datasets and interactive dashboards. This partnership ensures that the data infrastructure directly supports informed decision-making and strategic initiatives. Your ability to translate data into actionable insights will be highly valued.
• • A significant part of your contribution will involve writing, optimizing, and tuning complex SQL queries designed to handle large-scale analytical workloads efficiently. You will be expected to identify and resolve performance bottlenecks, ensuring that data retrieval is both fast and accurate. This requires a deep understanding of query execution plans and optimization techniques.
• • Ensuring the integrity, quality, and governance of data across the entire analytics platform is paramount. You will implement and enforce data quality checks, establish data lineage, and contribute to the overall data governance framework, ensuring that the data is trustworthy and compliant.
• • You will also play a key role in shaping the future of the data engineering practice by contributing to architectural decisions, defining best practices, and establishing coding standards. Your experience and insights will guide the team in adopting and implementing new technologies and methodologies.
• • This role offers the chance to work on international projects with a company that values trust, respect, and purpose. Exadel fosters a culture of open dialogue, creative freedom, and continuous mentorship, providing ample opportunities for professional growth and leadership. You will be part of a team that encourages challenging ideas, values diverse perspectives, and ensures that your impact is recognized and celebrated.
• • The client, a well-established provider in the health and fitness industry since 1981, relies on efficient data processing for their membership management and payment solutions. Your work will directly contribute to their ability to serve over 7,000 health clubs effectively, enhancing their operational capabilities and customer experience through advanced data solutions.
• • You will be working within a modern tech stack that includes Databricks (Spark, Delta Lake, SQL Warehouses), Azure Synapse, Azure SQL, and Power BI (DAX, semantic modeling, RLS), with a strong emphasis on SQL. This environment provides a rich landscape for data engineering innovation and problem-solving.
• • The position requires an Upper-Intermediate level of English proficiency to facilitate effective communication within the international project team and with stakeholders.
• • Exadel is committed to fostering an inclusive environment and is an Equal Opportunity Employer, ensuring that all individuals, regardless of background, have the opportunity to thrive. Reasonable accommodations are available for individuals with disabilities to perform essential functions.