Databricks Admin (Contract-To-Hire)

Databricks Admin

Location- Mumbai

Experience- 7+Years

Role- Contractual

Primary Skills :

Databricks Admin Primary Skills 1. Unity Catalog Administration, Data Governance Delta Sharing Administration 2. Workspace, Identity, Access Management (IAMBased) in Databricks 3. Cluster, Compute Platform Operations in Databricks Main 3 Competence Needed in Primary Skills : Primary Competencies - Ability to administer governed data access through Databricks Unity Catalog, manage catalogs/schemas/permissions, configure external locations, and operate Delta Sharing for secure crossplatform data exchange. - Proficiency in configuring, optimizing, and monitoring clusters, SQL warehouses, job compute, autoscaling, and cost controls to ensure a reliable, highperformance Databricks platform. - Strong competency in enforcing IAMbased security controls across workspaces and compute resources, combined with the ability to develop lightweight SQL and Python notebook solutions for platform monitoring, audit log insights, and operational visibility. JD - Design and manage catalogs/schemas, fine-grained permissions (tables/views/volumes), lineage, external locations, and storage credentials. - Configure providers/recipients, share permissions, and enforce secure cross-tenant/platform data sharing aligned with governance policies. - Implement and maintain IAM roles/policies for users, groups, service principals, clusters, jobs, and SQL warehouses; apply workspace/cluster policies. - Build and maintain lightweight notebooks/queries to track cluster usage, job reliability, DBU/compute cost, audit events, and resource health. - Implement cluster policies, right-sizing, pools, and scheduling strategies; produce usage and cost reports, alerts, and recommendations. - Enable/maintain audit logs, review access changes, and ensure alignment with data governance and regulatory requirements. - Troubleshoot platform issues, coordinate with Databricks support, and drive root-cause analysis and preventative actions Project Scope Tasks : Project Tasks - Configure Unity Catalog metastores, catalogs, schemas, and permissions. - Implement workspace and cluster policies for security and cost control. - Set up external locations, storage credentials, and governance rules in UC. - Prpvide support to Data engineering teams on migrating data objects from Hive Metastore to Unity Catalog. - Implement IAM roles/policies for users, groups, and service principals by leastprivilege access controls. - Configure Delta Sharing and Databricks Marketplace for secure crosstenant data exchange. - Develop SQL queries for monitoring costs, cluster usage, and job failures. - Build Python notebooks to analyze audit logs, performance, and autoscaling trends. - Automate monitoring notebooks using Jobs/Workflows. - Review and optimize compute costs using DBU usage analytics. - Maintain audit logging, access reviews, and compliance checks. - Troubleshoot platform issues, job failures, and performance bottlenecks. - Maintain documentation, runbooks, and operational standards. - Provide advisory support to data engineering and analytics teams.