Azure Data Engineer (PAN India)

We are seeking an experienced Senior Azure Data Engineer with strong expertise in Azure Data Factory (ADF), Data Flows, Azure Databricks, and CI/CD pipeline development. The ideal candidate will be responsible for designing and developing scalable data ingestion and transformation solutions while supporting enterprise data architecture initiatives within a banking environment.

Key Responsibilities

• Design, develop, and maintain enterprise-scale data pipelines using Azure Data Factory (ADF), Data Flows, and Azure Databricks.
• Build and support CI/CD pipelines for data engineering solutions.
• Develop robust data ingestion frameworks to process data from on-premises systems, cloud platforms, APIs, files, and databases.
• Implement data quality validation and monitoring controls across data pipelines.
• Work closely with Business Data Architects and Enterprise Architects to align solutions with target-state architecture.
• Support the design and implementation of data ingestion frameworks following banking and enterprise standards.
• Develop scalable, reusable, and high-performance data engineering solutions.
• Guide and mentor team members on best practices, coding standards, and solution design principles.
• Collaborate with business and technology teams to gather requirements and deliver high-quality data solutions.
• Participate in Agile ceremonies including sprint planning, estimation, reviews, and retrospectives.
• Ensure compliance with security, governance, and data management standards.

Required Skills

• Strong hands-on experience with Azure Data Factory (ADF).
• Experience with Azure Data Flows and Azure Databricks.
• Expertise in building and maintaining data pipelines and ETL/ELT solutions.
• Experience building CI/CD pipelines for data platforms.
• Strong understanding of data ingestion from APIs, files, databases, and cloud/on-premise systems.
• Experience implementing data quality controls and validation frameworks.
• Knowledge of enterprise data architecture and data integration patterns.
• Experience working in Agile development environments.
• Strong stakeholder management and communication skills.

Preferred Skills

• Banking or Financial Services domain experience.
• Azure Data Lake (ADLS).
• Azure DevOps.
• SQL and performance optimization.
• Data Warehousing and Data Modelling concepts.
• Cloud-native data architecture experience.

Desired Candidate Profile

• Strong problem-solving and analytical skills.
• Ability to mentor and guide junior engineers.
• Excellent communication and collaboration abilities.
• Experience working with cross-functional teams and enterprise architects.
• Proactive mindset with focus on scalable and reusable engineering solutions.