Data Engineer

📋 Description

• • Develop our comprehensive data processing pipeline transforming on-premises Kafka streams into both actionable business insights and regulatory compliance reports through AWS cloud services (S3, Glue, Athena, EMR). Design robust ETL processes and build automated, scalable data solutions aligned with our zero-maintenance vision, delivering high-quality outputs for both business decision-making and regulatory requirements.
• • Designing, developing, and maintaining ETL workflows using AWS services; processing data from Kafka streams and S3 storage to generate insights; implementing data transformation logic using Python, PySpark, and PyAthena; creating and optimizing data models for both analytical and regulatory reporting needs; building automated data quality checks and monitoring systems; developing and maintaining documentation for data pipelines and processes; troubleshooting and resolving data pipeline issues; contributing to architectural decisions for data infrastructure; ensuring data solutions meet performance, security, and compliance requirements; continuously improving our data systems for scalability and reduced maintenance.
• • We are the Realtime Order Analytics and Reporting team, a dynamic group focused on transforming financial transaction data into valuable business intelligence and regulatory reporting. We work with cutting-edge technologies, including AWS cloud services and realtime data processing; operate in a collaborative environment where innovation and ideas are encouraged; maintain a balance between technical excellence and business impact; value automation and efficiency in all our solutions; foster continuous learning and professional development; play a critical role in supporting business decision-making and ensuring regulatory compliance; embrace agile methodologies to deliver high-quality solutions efficiently.
• • You will gain deep expertise in AWS data engineering services, real-time data processing with Kafka, and scalable ETL pipelines using Python and PySpark. You will contribute to mission-critical financial data systems that power business intelligence and regulatory reporting, enhancing your impact in a global fintech leader while advancing your technical and analytical skills in a collaborative, innovative environment.