Data Engineering Lead - Databricks & Cloud Data Migration

Job Category: Azure Data Factory Azure SQL Delta Lake Microsoft Purview PostgreSQL Snowflake

Job Type: Full Time

Job Location: PAN India

Experience: 6 to 10 years
Joining Timeline: Immediate to a maximum of 15 days

Job Overview
We are looking for an experienced Data Engineer/Architect to lead cloud data platform modernization and migration initiatives, with strong expertise in Databricks (Unity Catalog, Delta Lake, Delta Sharing, Lakebase), enterprise ETL/ELT tools, and data governance frameworks. The candidate will drive Oracle-to-modern-platform migrations and support AI/ML-ready data product development.

Key Responsibilities

• Design and implement metadata governance, data cataloging, and secure data-sharing solutions using Databricks Unity Catalog and Delta Sharing.
• Build and manage cloud-native transactional/operational data capabilities leveraging Databricks Lakebase.
• Architect and execute data migration strategies from Oracle to modern platforms (Delta Lake, Snowflake, Azure SQL Database, Azure Synapse, PostgreSQL, MongoDB, etc.).
• Develop and orchestrate ETL/ELT pipelines using Azure Data Factory, dbt, Informatica, Fivetran, or equivalent tools.
• Implement enterprise data governance using Purview, Collibra, Alation, or Informatica EDC - covering lineage, data quality, and master data management (MDM).
• Support building AI/ML-ready data products, including feature engineering pipelines for downstream analytics/ML use cases.
• Collaborate with cross-functional teams to ensure compliance and governance standards, especially in regulated industries (healthcare, financial services, insurance).

Required Skills

• Hands-on experience with Databricks Unity Catalog, Delta Sharing, and metadata governance.
• Experience with Databricks Lakebase or similar cloud-native transactional/operational database capabilities.
• Strong cloud platform experience (Azure, AWS, or GCP).
• Proficiency with ETL/ELT tools - Azure Data Factory, dbt, Informatica, Fivetran, etc.
• Experience with data governance tools - Microsoft Purview, Collibra, Alation, or Informatica EDC.
• Proven experience migrating workloads from Oracle to Databricks Delta Lake, Snowflake, Azure SQL Database, Azure Synapse, PostgreSQL, MongoDB, or similar.
• Knowledge of data quality, lineage, MDM, and metadata management practices.
• Experience supporting AI/ML-ready data pipelines and feature engineering.
• Domain knowledge in healthcare, financial services, insurance, or other regulated industries is a plus.

Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.