Databricks admin

Experience: 3-5 Years
Location: PAN India
Employment Type: Full-Time

• Administer and maintain Databricks workspaces across development, testing, and production environments.
• Manage Databricks clusters, cluster policies, pools, jobs, and notebooks.
• Configure and maintain user access, RBAC, Unity Catalog, and security policies.
• Monitor platform health, cluster utilization, job performance, and resource consumption.
• Troubleshoot Databricks platform issues and provide timely resolution.
• Implement best practices for governance, security, compliance, and cost optimization.
• Manage integrations with cloud services such as Azure AD, AWS IAM, Key Vault, Secrets Manager, and cloud storage.
• Support CI/CD implementations using Azure DevOps, GitHub Actions, or Jenkins.
• Collaborate with Data Engineers, Data Scientists, and DevOps teams to ensure platform stability and scalability.
• Perform workspace migrations, upgrades, and environment setup activities.
• Create and maintain operational documentation, runbooks, and SOPs.

Required Skills

• 35 years of experience in Databricks administration and support.
• Strong knowledge of Databricks workspace management, clusters, jobs, and notebooks.
• Experience with Unity Catalog, Data Governance, and Security Administration.
• Hands-on experience with Azure Databricks, AWS Databricks, or GCP Databricks.
• Knowledge of Spark, PySpark, and SQL.
• Experience with cloud platforms (Azure/AWS/GCP).
• Understanding of IAM, RBAC, SSO, SCIM provisioning, and access management.
• Experience in monitoring and troubleshooting distributed data platforms.
• Familiarity with Git, CI/CD pipelines, and Infrastructure as Code concepts.
• Good understanding of data lake and cloud storage technologies.