Databricks Team Lead

Job Summary

Databricks Team Lead will lead hands-on technical migration activities for assigned Snowflake workloads, including discovery, Lakebridge analysis and conversion support, Snowflake SQL remediation, Databricks SQL and PySpark implementation, pipeline conversion, data movement support, reconciliation, and defect resolution across SIT, QA, PROD readiness, and hypercare.

Operate Lakebridge and support automated code conversion for eligible Snowflake workloads, SQL assets, jobs, and transformation logic.

Perform discovery of source assets, workload dependencies, job characteristics, and conversion readiness for assigned systems or domains.

Analyze conversion outputs, identify defects or unsupported patterns, and implement manual remediation where required.

Support migration of Python jobs for LZ data sourcing and assist with Airflow DAG repointing to Databricks jobs.

Implement Databricks-aligned data engineering components using approved project structure, coding standards, and deployment practices.

Support SIT, QA, and PROD readiness through technical validation, defect fixes, reconciliation support, and deployment verification.

Document conversion patterns, remediation decisions, technical exceptions, and handoff notes for operational support teams.

Responsibilities Required Skills and Experience

• Snowflake
• Databricks SQL
• PySpark
• Python
• Delta Lake
• Airflow
• SQL
• Git-based development
• CI/CD concepts