This job has expired

This position was posted on October 3, 2025 and is likely no longer accepting applications. We've kept it here for historical reference. Check out the similar jobs below!

Exadel Inc. logo

Senior Lead Data Engineer (Databricks)

Job Overview

Location

Remote

Job Type

Full-time

Category

Software Engineering

Date Posted

October 3, 2025

Full Job Description

đź“‹ Description

  • • Own the end-to-end architecture and delivery of cloud-scale data platforms that ingest, transform, and serve petabytes of data for Fortune 500 brands such as HBO, Microsoft, Google, and Starbucks. You will be the technical North Star for data engineering across 500 concurrent projects and 2,000 global teammates.
  • • Design, build, and optimize Databricks-centric lakehouse solutions on AWS, Azure, or GCP that unify batch and streaming workloads, reduce total cost of ownership by up to 40 %, and cut query latency from minutes to seconds for real-time AI and analytics use cases.
  • • Lead a distributed squad of 6-12 data engineers, platform SREs, and ML engineers; run agile ceremonies, mentor on Delta Live Tables, Unity Catalog, and Structured Streaming best practices, and create reusable accelerators that the entire 25-year engineering organization can adopt.
  • • Partner directly with C-suite stakeholders and product owners to translate business OKRs into technical epics, define SLAs/SLOs, and prioritize backlogs that balance quick-win dashboards with multi-quarter foundational investments.
  • • Establish enterprise-grade data governance, security, and compliance frameworks (GDPR, CCPA, SOC 2, HIPAA) using Unity Catalog, Ranger, and Lakehouse Federation; conduct quarterly audits and present findings to external regulators and client security councils.
  • • Champion a culture of data reliability by instituting automated testing, CI/CD, and observability (Great Expectations, dbt, Monte Carlo, Datadog) that achieves 99.9 % pipeline uptime and reduces on-call incidents by 60 % within the first year.
  • • Drive cost-optimization initiatives—rightsizing clusters, implementing auto-scaling policies, and leveraging spot instances—that save clients millions in cloud spend while maintaining performance SLAs.
  • • Spearhead the migration of legacy on-prem Hadoop and Teradata estates to modern lakehouse architectures; create detailed run-books, risk assessments, and rollback plans that guarantee zero-downtime cutover.
  • • Collaborate with AI research teams to productionize large-scale feature stores and model-serving endpoints on Databricks Model Serving and MLflow, enabling real-time personalization for 100 M+ end users.
  • • Publish thought-leadership blogs, speak at Databricks Data + AI Summit, and host internal guild sessions to evangelize lakehouse patterns across our global delivery centers in North America, LATAM, Europe, and APAC.
  • • Contribute to open-source Delta, Spark, and dbt projects; file PRs, triage issues, and maintain an internal fork that feeds enhancements back to the community.
  • • Own the technical interview loop for senior and staff-level data engineers; define coding challenges, architecture deep-dives, and culture-add rubrics that raise our hiring bar and diversify our talent pipeline.

🎯 Requirements

  • • 8+ years of hands-on data engineering experience with at least 3 years leading teams in Databricks-centric environments (Delta Lake, Structured Streaming, Unity Catalog).
  • • Expert-level proficiency in Python or Scala, SQL performance tuning, and cloud-native data services (AWS Glue, Azure Data Factory, GCP Dataflow).
  • • Proven track record designing multi-tenant lakehouse architectures that handle 1 TB+ daily ingestion and serve sub-second analytics to 1,000+ concurrent users.
  • • Nice-to-have: Databricks Certified Data Engineer Professional, AWS Solutions Architect Pro, or equivalent; experience with Terraform, Pulumi, or CDK for infrastructure-as-code.

🏖️ Benefits

  • • Fully remote-first culture with flexible hours and a $2,000 home-office stipend so you can build the perfect workspace anywhere in the world.
  • • Annual professional-development budget of $5,000 plus 10 paid learning days to attend conferences, pursue certifications, or enroll in advanced courses.
  • • Premium health, dental, and vision coverage for you and your family, plus a quarterly wellness stipend covering gym memberships, therapy, and mindfulness apps.
  • • 20 days PTO, 12 company holidays, and a 4-week paid sabbatical every 4 years to recharge and explore new horizons.

Skills & Technologies

Senior
Remote

Ready to Apply?

You will be redirected to an external site to apply.

Exadel Inc. logo
Exadel Inc.
Visit Website

About Exadel Inc.

Exadel is a U.S.-based global software engineering company founded in 1998. It provides digital transformation and custom application development services to enterprises, leveraging cloud, AI, and modern architectures. The company offers product strategy, UX/UI design, full-stack development, QA, and managed support across industries including financial services, healthcare, retail, and technology. Headquartered in Walnut Creek, California, Exadel maintains delivery centers in Eastern Europe and Asia, combining nearshore agility with enterprise-grade processes. Clients range from Fortune 500 firms to growth-stage companies seeking scalable, secure software solutions.

Similar Opportunities

❌ EXPIRED
Scale to Win LLC logo

Scale to Win LLC

Remote
Full-time
Expired Jan 22, 2026
Senior
Remote

3 months ago

Apply
Remote - USA
Full-time
Expires May 2, 2026
Senior
Remote

4 days ago

Apply
Dandy Technology, Inc. logo

Dandy Technology, Inc.

USA - Remote
Full-time
Expires May 3, 2026
REST
Remote

3 days ago

Apply
Remote - Canada
Full-time
Expires May 2, 2026
Go
MongoDB
Redis
+3 more

4 days ago

Apply