Job Overview
Location
All Cities
Job Type
Full-time
Category
Software Engineering
Date Posted
June 26, 2026
Full Job Description
đź“‹ Description
- • Build the first analytical data platform on GCP from scratch, serving as the foundational data layer for both internal AI agents and customer-facing AI features.
- • Design and implement ELT/CDC pipelines using GCP-native tools (Datastream, Dataflow, Pub/Sub) and dbt to ingest and transform data from production Postgres and .NET/C# services.
- • Establish orchestration workflows using Cloud Composer/Airflow or Dagster, with integrated CI/CD pipelines, automated testing, and monitoring for data reliability.
- • Create dimensional data models and a documented semantic/metrics layer to ensure consistent definitions across dashboards, data analysts, and internal Claude-based AI agents.
- • Develop and maintain the AI-specific data layer including embeddings pipelines, vector storage (e.g., pgvector, Vertex AI Vector Search), and RAG infrastructure to ground LLM agents in accurate, up-to-date data.
- • Implement data governance controls including validation rules, lineage tracking, observability tooling, and PII masking for sensitive financial, donor, payments, and cross-border tax data.
- • Partner closely with the Senior AI Engineer to align data architecture with agent logic and orchestration, ensuring seamless integration between data retrieval and AI reasoning layers.
- • Collaborate with the .NET backend team to instrument product events and ensure accurate, timely data capture from application layers for downstream analytics and AI features.
- • Own end-to-end delivery of the data platform, from initial architecture design through deployment, scaling, and ongoing maintenance.
- • Ensure all data pipelines and storage systems meet compliance requirements for handling international financial and donor data across jurisdictions.
- • Build and maintain feature stores that feed predictive and prescriptive insights into customer-facing dashboards powered by AI models.
- • Establish data quality standards and monitoring frameworks to detect anomalies, schema drift, and latency issues in real-time.
- • Document all data models, pipelines, and governance policies to enable knowledge sharing and onboarding of future team members.
- • Support data analysts and product teams by providing clean, reliable, and well-documented datasets for reporting and experimentation.
- • Continuously evaluate and adopt new GCP data services to improve platform performance, scalability, and cost-efficiency.
- • Contribute to the evolution of the company’s data strategy by identifying opportunities to enhance data utility for AI and business intelligence.
🎯 Requirements
- • 6+ years of Data Engineering experience, including at least one greenfield warehouse/platform build owned end-to-end.
- • Expert SQL and deep PostgreSQL experience, alongside strong experience with cloud data warehouses (BigQuery is ideal).
- • Strong ELT/ETL design using dbt and a modern orchestrator (Airflow/Cloud Composer or Dagster).
- • Hands-on with the GCP data stack (BigQuery, Datastream, Dataflow, Pub/Sub, Cloud Storage).
- • Proficient in Python for building data pipelines and custom tooling.
- • Demonstrable LLM/AI data experience: Embeddings pipelines, vector stores (e.g., pgvector, Vertex AI Vector Search, Pinecone), RAG plumbing, or feature stores feeding production ML/LLM systems.
🏖️ Benefits
- • Remote or Hybrid Work Options
- • Private Health Insurance, including dental care
- • Additional Holidays after your 1st and 5th year
- • Sponsored Training & Certifications
- • Employee Referral Bonuses
- • Multisport Card – fully covered
Skills & Technologies
See exactly how your profile matches this role — strengths, skill gaps, and what to do about them.
About Ndeavour Tech Pvt. Ltd.
Ndeavour is an Indian technology services company founded in 2014 that designs, builds and manages cloud-native software products and data platforms for global enterprises. Core offerings span product engineering, cloud infrastructure, data engineering, AI/ML solutions and managed DevOps, delivered through agile squads integrated with client teams. The firm focuses on sectors including fintech, healthtech, logistics and e-commerce, emphasizing scalability, security and rapid iteration. Headquartered in Pune with additional offices in Bengaluru and Singapore, Ndeavour operates ISO 27001-certified processes and serves Fortune 500 and high-growth scale-ups across North America, Europe and Asia-Pacific.
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
Similar Opportunities
Vanta, Inc.
3 months ago
Keyrock NV
3 months ago
Cloudera, Inc.
3 months ago
OpenAI, Inc.
3 months ago