Lead Databricks Engineer

Lead Databricks Engineer - Fully Remote B2B Contract - €550 - 650 p/d

My client is looking for an experienced Lead Databricks Engineer to take technical ownership of a large-scale data platform for an enterprise client. You will shape the architecture, lead delivery and support a team of data engineers while remaining hands-on.

You will:

• Lead the technical delivery of enterprise data-platform projects.
• Design scalable ETL and ELT pipelines using Lakehouse and Medallion architecture.
• Own the architecture, governance, performance and cost efficiency of the Databricks environment.
• Work directly with business stakeholders and technical teams.

Technical Environment

• Databricks, Workflows and Lakeflow Pipelines
• PySpark/Spark
• Spark performance tuning, including clustering, partitioning, skew management and compute optimisation
• Azure services
• Python and SQL
• Lakehouse and Medallion architecture