Senior Data Engineer Real-Time Distributed Systems (GCP)

📋 Description

• • We are seeking a highly skilled and experienced Senior Data Engineer with a specialization in Real-Time and Distributed Systems, to join our dynamic team on a 6-month contract basis. Innodata (NASDAQ: INOD) is a globally recognized leader in data engineering, renowned for empowering 4 out of the world's top 5 technology companies, alongside leading organizations in financial services, insurance, technology, law, and medicine. With a robust presence across 13 cities and over 3,000 dedicated employees worldwide, we are at the forefront of leveraging advanced machine learning and artificial intelligence (ML AI) technologies. Our mission is to deliver clean, optimized digital data solutions, underpinned by a global workforce of subject matter experts and a secure, high-performance infrastructure. This role is crucial for our continued growth and innovation, particularly as we expand our capabilities in real-time data processing and distributed systems.
• • As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing our data infrastructure. Your expertise will be instrumental in building and maintaining scalable data pipelines that handle both batch and real-time processing workloads. A significant focus of this role will be on developing and maintaining robust event-driven architectures, ensuring our systems can manage high-throughput data streams with exceptional reliability and low latency. You will be working with cutting-edge technologies on the Google Cloud Platform (GCP), a key component of our modern data stack.
• • Your responsibilities will extend to ensuring the utmost data reliability, performance, and efficiency across our distributed environments. This involves not only building new systems but also continuously optimizing existing ones to meet the ever-increasing demands of our clients and internal stakeholders. You will collaborate closely with cross-functional teams, including data scientists, machine learning engineers, and application development teams. This collaboration is essential to understand their data needs, provide them with the necessary data sets, and enable advanced analytics, machine learning models, and AI use cases. Your contributions will directly impact our ability to derive actionable insights and drive data-informed decisions.
• • Furthermore, you will be responsible for implementing and championing best practices in data engineering. This includes meticulous performance tuning of data pipelines and systems, establishing comprehensive monitoring solutions to ensure system health and identify potential issues proactively, and implementing strategies for cost optimization within the GCP environment. Your insights into efficient resource utilization will be highly valued. You will also be involved in troubleshooting complex data-related issues, identifying root causes, and implementing effective solutions to maintain data integrity and system stability. The ideal candidate will possess a deep understanding of distributed computing principles and experience in building resilient, fault-tolerant data systems. This contract position offers a unique opportunity to contribute to high-impact projects within a leading data engineering firm, working with a talented team and on challenging, real-world data problems. You will have the chance to shape and enhance our real-time data capabilities, directly contributing to Innodata's mission of delivering superior data solutions.