Senior Data Engineer (Databricks / AWS)

Ndeavour Tech Pvt. Ltd.

Job Overview

Location

All Cities

Job Type

Full-time

Full Job Description

📋 Description

• Design and implement robust, scalable data ingestion and transformation pipelines using Databricks, PySpark, and distributed processing. Utilize Airflow (or similar) for reliable workflow orchestration.
• Implement Delta Lake principles, focusing on CDC and schema evolution. Establish and integrate data quality frameworks (e.g., Great Expectations) within CI/CD pipelines for data integrity.
• Develop and optimize complex SQL and Python scripts. Integrate diverse data sources (APIs, S3 files, etc.) and handle both structured and unstructured data.
• Support the implementation of data governance and cataloguing solutions (e.g., Unity Catalog). Proactively investigate and improve inconsistent legacy datasets.
• Guide and manage AI agents for code generation, ensuring quality and stability. Work pragmatically and collaboratively to drive technical solutions.

🎯 Requirements

• 5+ years of professional experience in data engineering, focused on cloud and distributed processing environments.
• Strong experience with Databricks, PySpark, distributed processing, and Delta Lake. Deep knowledge of CDC and schema evolution.
• Expert SQL optimization and Python skills. Hands-on experience with Airflow (or similar).

🏖️ Benefits

• Remote Office – Flexible hybrid form of working
• Parking Space – We provide free parking spots
• Fun Office Space – We offer a game zone and a relaxation area
• Health Insurance – Additional private health insurance, including a dental care plan
• Personal Development – Company-sponsored training budget to further develop your skills
• Employee Referral Program – Receive a bonus for referring a friend
• Holidays – Enjoy an extra 5 days after your 1st and 5th year
• Social Events – We love to celebrate our success together
• Family Insurance – Add insurance to a family member
• Offering sports cards – 100% sponsored by the company

Skills & Technologies

Python

AWS

Kafka

Senior

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

AI Job Fit Analysis

Pro

See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.

Ndeavour Tech Pvt. Ltd.

Visit Website

About Ndeavour Tech Pvt. Ltd.

Ndeavour is an Indian technology services company founded in 2014 that designs, builds and manages cloud-native software products and data platforms for global enterprises. Core offerings span product engineering, cloud infrastructure, data engineering, AI/ML solutions and managed DevOps, delivered through agile squads integrated with client teams. The firm focuses on sectors including fintech, healthtech, logistics and e-commerce, emphasizing scalability, security and rapid iteration. Headquartered in Pune with additional offices in Bengaluru and Singapore, Ndeavour operates ISO 27001-certified processes and serves Fortune 500 and high-growth scale-ups across North America, Europe and Asia-Pacific.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.