Azure Databricks Engineer

Job Title: Azure Databricks Engineer

Job Location: Chicago, IL

Job Type: Contract

Job Description

We are looking for an experienced Azure Databricks Engineer to design, develop, and support scalable data engineering solutions on Microsoft Azure. The ideal candidate will have strong experience with Azure Databricks, data pipelines, ETL/ELT, SQL, and Azure Data Factory .

Key Responsibilities

• Develop and maintain data pipelines using Azure Databricks and Azure Data Factory (ADF) .
• Build scalable ETL/ELT processes using Python, PySpark, and SQL .
• Work with large datasets and optimize data processing and performance.
• Develop and maintain data solutions using Azure Data Lake Storage (ADLS) .
• Perform troubleshooting, root cause analysis, and production support.
• Monitor data pipelines and resolve data quality and performance issues.
• Collaborate with data architects, developers, and business teams to deliver data solutions.
• Follow best practices for data security, reliability, and performance.

Must-Have Skills

• Azure Databricks
• PySpark / Python
• SQL
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS)
• ETL / ELT
• Data Engineering
• Production Support & Troubleshooting
• Strong understanding of Azure Cloud

Preferred Skills

• Azure Synapse Analytics
• Delta Lake
• Databricks Workflows
• Git / Azure DevOps
• CI/CD
• Data Warehousing