Senior Data Engineer (DBT/Snowflake)

📋 Description

• • As a Senior Data Engineer at Tide Platform Limited, you will play a pivotal role in shaping and executing our data strategy, focusing on building and maintaining robust, scalable data pipelines and services that power critical business functions, reporting, and dashboards.
• • You will be instrumental in developing end-to-end ETL/ELT pipelines, collaborating closely with Data Analysts from various business functions to translate their needs into efficient and reliable data solutions.
• • Your responsibilities will include designing, developing, and implementing automated processes for data extraction, transformation, and loading, adhering to a modern Data Mesh architecture.
• • This role offers a unique opportunity to act as a subject matter expert, becoming a go-to resource for data technologies and solutions within the organization.
• • You will be expected to provide hands-on troubleshooting and diagnostic support for architecture and design challenges, ensuring the smooth operation of our data infrastructure.
• • A key aspect of the role involves proactively identifying and resolving technical issues within data pipelines, minimizing downtime and ensuring data availability.
• • You will continuously seek opportunities to enhance both the 'what' and the 'how' of data pipeline delivery, driving innovation and efficiency within the department.
• • A significant part of your work will involve translating complex business requirements into detailed technical specifications, including defining data models, developing DBT models, setting up timings, implementing tests, and creating reports.
• • You will take ownership of the end-to-end delivery of data models and reports, from conception through to deployment and maintenance.
• • Performing exploratory data analysis will be crucial for early identification of data quality issues, and you will implement robust testing strategies to prevent future occurrences.
• • You will collaborate with Data Analysts to ensure all data feeds are optimized for performance and availability, employing techniques such as Change Data Capture (CDC) and delta loading approaches.
• • The role involves the entire lifecycle of data sources: discovering, transforming, testing, deploying, and documenting them thoroughly.
• • You will be a champion for data warehouse governance, actively applying, defining, and promoting best practices in data quality, testing, coding standards, and peer review processes.
• • While not the primary focus, there may be opportunities to build Looker Dashboards for specific use cases, contributing to our business intelligence capabilities.
• • You will contribute to a culture of technical excellence, emphasizing high development standards, code quality, rigorous code reviews, unit testing, and continuous integration/continuous deployment (CI/CD) practices.
• • Your ability to document technical solutions clearly and precisely will be vital for effective communication with both technical and business stakeholders.
• • As a Senior Data Engineer, you will also be expected to mentor junior engineers, sharing your expertise and fostering their growth within the team.
• • You will be working with a modern data stack, including technologies like DBT, Snowflake, Apache Airflow, Fivetran, AWS, Git, and Looker, contributing to Tide's data-driven decision-making processes.
• • The role is embedded within an agile, cross-functional delivery team, requiring strong collaboration and communication skills.
• • You will be part of a company that is transforming the small business banking market, with over 1.8 million members globally, and a mission to help SMEs save time and money.