Databricks Technical Lead

Location: Pune Employment Type: full-time

Job Details

Key Responsibilities & Skills

• Strong hands-on experience in Azure Databricks, Apache Spark, PySpark and SQL.
• Strong understanding of Delta Lake, Medallion Architecture, ETL/ELT pipelines and modern data engineering practices.
• Experience in designing, developing and supporting scalable data pipelines and data processing workloads on Databricks.
• Strong experience in performance tuning, optimization and troubleshooting of Spark jobs, clusters and data pipelines.
• Experience in handling production support, complex incidents, root cause analysis and problem management in Databricks/Data Platform environments.
• Ability to provide technical leadership and architectural guidance for the Databricks and overall Data Platform landscape.
• Strong knowledge of Azure Data Factory, Azure Data Lake Storage and related Azure Data Services.
• Experience in integrating Databricks with enterprise data warehouses, databases and upstream/downstream applications.
• Good understanding of data warehousing, dimensional modeling and enterprise data integration concepts.
• Experience in code review, release management, deployment and production readiness activities.
• Ability to support minor enhancements, continuous improvements and ongoing platform modernization initiatives.
• Experience in leading technical discussions, mentoring engineers and guiding teams on complex technical issues.
• Ability to work directly with client stakeholders and technical teams on priorities, issues and technical decisions.
• Strong communication and stakeholder management skills, with the ability to work independently in a client-facing environment.
• Willingness to provide support during US business hours, including availability for critical production issues as required.
• Experience in retail or a similar data-intensive enterprise environment.
• Experience with legacy EDW/SQL Server environments is an added advantage.