Middle/Senior DataOps Engineer

📋 Description

• • As a Middle/Senior DataOps Engineer at Exadel, you will play a pivotal role in shaping and maintaining the robust data infrastructure for a leading health and fitness software and payment processing provider. This is an exciting opportunity to contribute to a company that has been at the forefront of its industry since 1981, serving over 7,000 health clubs across the United States, Puerto Rico, Canada, and Mexico. You will be instrumental in migrating critical systems from Synapse to Databricks, ensuring a seamless transition and enhancing the overall data processing capabilities.
• • Your primary responsibility will involve building and maintaining sophisticated infrastructure and deployment pipelines that are essential for the efficient and reliable operation of data streams. This includes automating the provisioning, configuration, and ongoing monitoring of Databricks environments, ensuring they are optimized for performance and scalability across various data sources.
• • A key aspect of your role will be to ensure the smooth execution of Continuous Integration and Continuous Deployment (CI/CD) processes specifically tailored for data engineering workloads. This encompasses automating the initial data load processes, facilitating the deployment of data marts and consumption layers, and ensuring seamless integration with vital reporting tools and solutions like Power BI.
• • You will collaborate closely with a cross-functional team of Data Engineers, product specialists, and business stakeholders. This collaborative approach is crucial for guaranteeing the consistent, reliable, and secure delivery of data, which underpins critical business decisions and client services.
• • A significant part of your contribution will be focused on optimizing the performance, scalability, and cost-efficiency of our cloud-based data environments. This involves continuous analysis and implementation of strategies to ensure our infrastructure is not only powerful but also economically viable.
• • To maintain the highest levels of system health and reliability, you will be responsible for implementing comprehensive monitoring, alerting, and logging solutions. These systems will provide real-time insights into system performance and proactively identify potential issues before they impact operations.
• • You will leverage Infrastructure as Code (IaC) principles to write and maintain declarative configurations, enabling repeatable, version-controlled, and auditable deployments of our data infrastructure. This ensures consistency and reduces the risk of manual errors.
• • A critical function of this role is to efficiently troubleshoot and resolve any environment, pipeline, or integration issues that may arise. Your ability to quickly diagnose and fix problems will be vital in minimizing downtime and ensuring business continuity.
• • You are expected to stay abreast of the latest DevOps best practices, emerging technologies, and advancements within the cloud and data ecosystem. This continuous learning will ensure that our infrastructure remains modern, secure, and efficient.
• • This role offers the chance to work on international projects within a dynamic and evolving tech landscape, contributing to the digital transformation of a well-established client in the health and fitness sector. Your work will directly impact the operational efficiency and data-driven insights of thousands of health clubs.
• • You will be part of an AI-first global tech company with a strong legacy of engineering excellence, working with a team of over 2,000 professionals on projects for Fortune 500 clients. Exadel fosters a culture of ambition, collaboration, and continuous evolution, providing ample opportunities for professional growth and development.