Data Platform Engineer

We are posting this job on behalf of our client.

We are looking for an experienced Databricks Administrator to manage, support, and optimize enterprise data platforms built on Azure Databricks. The ideal candidate should have strong hands-on experience in Databricks administration, data governance, monitoring, access control, and production support in large-scale data environments.

Responsibilities:

Administer and manage Azure Databricks workspaces, clusters, and jobs across environments

Configure and maintain Databricks clusters (job & all-purpose) with cost and performance optimization

Manage Unity Catalog, metastores, schemas, tables, and data lineage

Implement and manage RBAC, access controls, service principals, and audit logs

Monitor Databricks jobs, pipelines, and clusters; troubleshoot failures and performance issues

Support batch and streaming workloads running on Databricks

Integrate Databricks with ADF, ADLS Gen2, Azure Key Vault, and Synapse

Implement error handling, logging, alerts, and operational dashboards

Handle deployments, environment promotions, and production support activities

Collaborate with data engineers, analytics, and platform teams to ensure platform stability

Ensure adherence to data governance, security standards, and best practices