Azure DevOps Engineer: ADF, Databricks & Terraform

We are looking for an experienced Azure DevOps Engineer with strong hands-on expertise in Azure Data Factory (ADF), Azure Databricks, Terraform, and Azure DevOps. The candidate will be responsible for supporting cloud-based data solutions, CI/CD automation, infrastructure provisioning, and deployment across Azure environments.

Key Responsibilities

• Design, implement, and maintain CI/CD pipelines using Azure DevOps.
• Develop and manage data pipelines using Azure Data Factory (ADF).
• Work with Azure Databricks for data processing, transformation, and integration.
• Provision and manage Azure infrastructure using Terraform / Infrastructure as Code (IaC).
• Automate deployments across development, testing, and production environments.
• Manage source code and version control using Git.
• Troubleshoot deployment, pipeline, and infrastructure-related issues.
• Collaborate with Data Engineers, Developers, Architects, and other stakeholders.
• Implement best practices for cloud security, scalability, monitoring, and deployment automation.

Required Skills

• 5+ years of experience in Azure DevOps / Cloud / Data Engineering.
• Strong hands-on experience with Azure DevOps and CI/CD.
• Hands-on experience with Azure Data Factory (ADF).
• Strong experience with Azure Databricks.
• Strong hands-on experience with Terraform.
• Good knowledge of Microsoft Azure services and cloud environments.
• Good understanding of SQL and data engineering concepts.
• Experience with Git and YAML-based pipelines.
• Scripting experience with Python, PowerShell, or Bash is an advantage.

Good to Have

• Azure Data Lake Storage (ADLS Gen2)
• PySpark
• Azure Synapse Analytics
• Azure Key Vault
• Terraform modules and state management
• Azure RBAC and cloud security

Key Technologies: Azure DevOps | Azure Data Factory | Azure Databricks | Terraform | Azure | CI/CD | Git | SQL | PySpark

Note: Candidates should have strong hands-on experience in ADF, Databricks, and Terraform. Profiles with only generic Azure DevOps experience may not be suitable.