Middle/Senior DataOps Engineer

📋 Description

• • As a Middle/Senior DataOps Engineer at Exadel, you will play a pivotal role in shaping and maintaining the data infrastructure for a leading health and fitness software and payment processing provider. This is an exciting opportunity to contribute to a company that has been at the forefront of its industry since 1981, serving over 7,000 health clubs with innovative solutions for membership tracking, schedule management, and automated payment processing.
• • Your primary responsibility will be to support a critical migration from Synapse to Databricks, a move that will enhance the client's data capabilities and enable more sophisticated analytics and insights. This involves the meticulous design, development, and maintenance of robust infrastructure and deployment pipelines that are essential for seamless data operations.
• • You will be instrumental in automating the provisioning, configuration, and ongoing monitoring of Databricks environments. This automation will span across multiple, diverse data streams, ensuring efficiency, consistency, and reliability in how data is managed and processed.
• • A key aspect of your role will be to ensure the smooth and efficient functioning of CI/CD processes specifically tailored for data engineering workloads. This includes automating the initial data load, deploying data marts and consumption layers, and integrating these with critical reporting tools and solutions like Power BI, thereby democratizing data access and insights across the organization.
• • Collaboration is at the heart of this role. You will work closely with Data Engineers, product teams, and various business stakeholders. This cross-functional teamwork is crucial to guarantee the reliable, secure, and timely delivery of data, ensuring that business needs are met and that data-driven decisions can be made with confidence.
• • You will be tasked with optimizing the performance, scalability, and cost-efficiency of the data infrastructure within cloud environments. This involves a continuous effort to refine existing systems and implement new strategies to ensure that the infrastructure can handle growing data volumes and complex processing requirements while remaining economically viable.
• • Implementing comprehensive monitoring, alerting, and logging solutions is vital for maintaining the overall health and reliability of the systems. You will establish frameworks that provide real-time visibility into system performance, enabling proactive identification and resolution of potential issues before they impact users or operations.
• • A significant part of your contribution will involve writing and maintaining Infrastructure as Code (IaC). This practice ensures that deployments are repeatable, version-controlled, and auditable, leading to greater consistency and reduced risk of manual errors in infrastructure management.
• • You will be the go-to person for troubleshooting and resolving environment, pipeline, and integration issues. Your ability to diagnose and fix problems efficiently will be critical in minimizing downtime and ensuring the continuous flow of data and services.
• • To stay ahead of the curve, you will be expected to continuously learn and stay current with the latest DevOps best practices and emerging technologies within the cloud and data ecosystem. This commitment to professional development will ensure that the client's data infrastructure remains modern, secure, and efficient.
• • This role offers the chance to work on international projects, contributing to the success of a well-established company with a global reach. You will be part of an ambitious, collaborative team that values innovation and continuous improvement, making a tangible impact on the health and fitness industry.