Azure Data Engineer D&A

Role & responsibilities

We are looking for an experienced Azure Data Engineer with 6 to 10 years of experience in designing, developing, and maintaining enterprise-scale data solutions on Microsoft Azure. The ideal candidate should have strong expertise in Azure data services, ETL/ELT development, data warehousing, big data technologies, and cloud-based data engineering practices.

Preferred candidate profile

Must Have Skills

• Azure Data Factory (ADF)
• Azure Databricks
• Azure Data Lake Storage (ADLS Gen2)
• Azure Synapse Analytics
• Azure SQL Database
• PySpark
• Python
• SQL
• Azure DevOps / CI-CD
• Data Modeling
• Power BI (Good to Have)
• Delta Lake
• Git Version Control

Roles & Responsibilities

• Design, develop, and implement scalable data pipelines using Azure Data Factory and Databricks.
• Build and optimize ETL/ELT processes for structured and unstructured data.
• Develop data ingestion frameworks from multiple source systems into Azure Data Lake.
• Create and maintain data models, data warehouses, and data marts.
• Work with business stakeholders to understand data requirements and translate them into technical solutions.
• Optimize Spark jobs and SQL queries for performance and scalability.
• Implement data quality, governance, security, and monitoring practices.
• Collaborate with Data Scientists, Architects, and BI teams for end-to-end data solutions.
• Automate deployment processes using Azure DevOps and CI/CD pipelines.
• Troubleshoot production issues and provide timely resolutions.
• Ensure compliance with security and governance standards.