Data Engineer – Databricks

About the role

We are looking for an experienced Data Engineer with strong expertise in Databricks to design, develop, and optimize scalable data solutions. You will work closely with multiple teams, contribute to key technical decisions, and help ensure efficient, reliable, and high-quality data pipelines.

Key responsibilities

• Design, develop, and optimize data pipelines for efficient data processing and integration.
• Develop and maintain data solutions using Databricks.
• Monitor and troubleshoot data quality and pipeline issues.
• Implement corrective actions to ensure data accuracy and reliability.
• Work with multiple teams and provide technical solutions to complex data challenges.
• Contribute to technical and team-level decisions as a subject matter expert.
• Document data processes, workflows, and best practices.
• Collaborate with cross-functional teams to improve data accessibility and usability.

About you

• 5+ years of hands-on experience with Databricks
• Strong expertise in Databricks Unified Data Analytics Platform
• Experience with Databricks Unity Catalog, Delta Live Tables (DLT), and Auto Loader
• Strong proficiency in Python and PySpark
• Strong knowledge of SQL
• Hands-on experience with Azure Data Factory (ADF)
• Strong understanding of data modeling and database design
• Experience with ETL and data integration
• Knowledge of data warehousing concepts and practices
• Familiarity with cloud-based data engineering platforms and services