Databricks Engineer

📋 Description

• • As a Databricks Engineer at Plain Concepts S.L., you will design, build, and scale a modern data platform on Apache Spark and Delta Lake, enabling reliable and high-performance data pipelines for data scientists, analysts, and backend teams.
• • Your day-to-day responsibilities include designing end-to-end data pipelines using Databricks Jobs, Workflows, and Delta Live Tables; building scalable ETL/ELT processes with PySpark or Scala; developing optimized data models in Delta Lake with partitioning, Z-ordering, and schema design; managing and tuning Databricks clusters for cost and performance; implementing CI/CD via Terraform, Azure DevOps, or GitHub Actions; ensuring data quality through validation and monitoring; enforcing data governance with Unity Catalog; troubleshooting Spark performance issues; and collaborating with stakeholders to define data SLAs and contracts.
• • You will join a remote-first team at Plain Concepts S.L., a technology consultancy focused on delivering innovative data, cloud, and AI solutions, where engineering excellence and collaboration are central to solving complex data challenges at scale.
• • In this role, you will deepen your expertise in large-scale data engineering, gain hands-on experience with enterprise-grade Databricks implementations, contribute to platform architecture decisions, and become a trusted advisor on data performance, reliability, and governance—positioning you for growth into senior platform or data engineering leadership roles.