Azure DevOps Engineer – Azure Databricks & Terraform

Job Description: Azure DevOps Engineer – Azure Databricks & Terraform

Job Overview

We are looking for an experienced Azure DevOps Engineer to design, implement, and maintain secure, scalable, and automated cloud infrastructure and data platform solutions using Microsoft Azure, Terraform, GitLab CI/CD, and Azure Databricks.

The role involves Infrastructure as Code (IaC), CI/CD pipeline development, cloud infrastructure automation, platform security, and deployment management. The candidate will collaborate with Data Engineers, Solution Architects, Security Teams, and Platform Engineers to deliver reliable, secure, and cost-effective cloud solutions.

Key Responsibilities

• Design, develop, and maintain Infrastructure as Code (IaC) solutions using Terraform.
• Build and manage GitLab CI/CD pipelines for infrastructure provisioning and application deployments.
• Automate the provisioning and management of Azure resources, including Databricks workspaces, Unity Catalog, Storage Accounts, Key Vaults, Managed Identities, and networking components.
• Develop deployment frameworks for Databricks Asset Bundles, Workflows, notebooks, libraries, and cluster policies.
• Create reusable Terraform modules, CI/CD templates, and automation scripts.
• Implement security controls, access management, governance, and compliance across Azure and Databricks environments.
• Configure and manage Azure networking components, including Virtual Networks, Private Endpoints, Private DNS Zones, and network security controls.
• Monitor platform performance, availability, resource utilization, and cloud expenditure.
• Identify opportunities for Azure cost optimization and implement FinOps best practices.
• Troubleshoot infrastructure, deployment, networking, authentication, and connectivity issues.
• Collaborate with cross-functional teams and participate in Agile ceremonies and continuous improvement initiatives.
• Support cloud platform modernization and enterprise data engineering workloads.

Required Skills & Experience

• 5+ years of experience in DevOps, Cloud Engineering, Platform Engineering, or a similar role.
• 5+ years of experience designing and managing enterprise-scale solutions on Microsoft Azure.
• Strong hands-on experience with Terraform and Infrastructure as Code.
• Good experience with GitLab, Git-based workflows, and CI/CD pipeline development.
• Strong understanding of Azure services, including:
• Azure Storage Accounts
• Azure Key Vault
• Azure Monitor
• Microsoft Entra ID and Managed Identities
• Experience with Azure networking, including Virtual Networks, Private Endpoints, Private DNS Zones, and network security.
• Proficiency in automation and scripting using Bash, PowerShell, or Python.
• Understanding of cloud-based data platforms, data engineering workflows, and analytics architecture.
• Familiarity with FinOps practices and Azure cost optimization.
• Strong troubleshooting, analytical, communication, and collaboration skills.
• Experience working in Agile delivery environments.

Preferred / Good-to-Have Skills

• Hands-on experience with Azure Databricks workspace administration and configuration.
• Knowledge of Unity Catalog, Databricks Asset Bundles, Databricks Workflows, and deployment automation.
• Experience supporting enterprise data platforms and data engineering workloads.
• Knowledge of security, governance, and access controls in Azure and Databricks.
• Exposure to observability and monitoring tools such as Dynatrace, Grafana, Elasticsearch, Fluent Bit, and OpenTelemetry.
• Experience with Azure Kubernetes Service (AKS) and Azure application platforms.

Educational Qualifications

Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related discipline, or equivalent practical experience.

Key Competencies

• Strong ownership and accountability.
• Ability to work independently and solve complex technical problems.
• Focus on automation, reliability, security, and operational excellence.
• Effective collaboration with cross-functional and distributed teams.
• Proactive approach to platform improvement and cost optimization.
• Excellent written and verbal communication skills.

Pay: ₹3,000,000.00 - ₹4,000,000.00 per year

Benefits:

• Provident Fund

Work Location: In person