Azure Data Engineer

Job Description Azure Data Engineering Lead

Role: Azure Data Engineering Lead / Azure Cloud Lead
Experience: 8+ Years
Location: Pan India
Employment Type: Permanent Opportunity

About the Role

We are looking for an experienced Azure Data Engineering Lead with strong expertise in Azure Data Factory (ADF), Azure Databricks, and Azure Cloud technologies. The candidate will be responsible for designing, developing, and leading scalable data engineering solutions on the Azure platform.

Key Responsibilities

• Lead the design and development of enterprise-grade data solutions using Azure Data Factory and Azure Databricks.
• Design and implement scalable and reliable data pipelines for data ingestion, transformation, and processing.
• Develop complex data transformation workflows using Databricks and PySpark.
• Build and maintain ETL/ELT pipelines using Azure Data Factory.
• Work with Azure data services and integrate data from multiple sources.
• Provide technical leadership and mentor data engineering team members.
• Collaborate with architects, business stakeholders, and development teams to understand requirements and deliver solutions.
• Optimize data pipelines and Databricks workloads for performance and cost efficiency.
• Implement monitoring, logging, error handling, and operational support for data pipelines.
• Ensure data quality, security, governance, and compliance across solutions.
• Participate in architecture discussions, technical design, code reviews, and deployment activities.
• Troubleshoot production issues and provide effective technical solutions.

Required Technical Skills

Must Have:

• 8+ years of experience in Data Engineering / Azure Cloud.
• Strong hands-on experience with Azure Data Factory (ADF).
• Strong experience with Azure Databricks.
• Good knowledge of PySpark / Spark.
• Strong SQL skills.
• Experience designing and implementing ETL/ELT pipelines.
• Good understanding of Azure cloud architecture and data services.
• Experience with data integration and processing at enterprise scale.
• Strong problem-solving and analytical skills.
• Experience leading technical teams or projects.