Senior Azure Data Engineer

Roles and Responsibilities

• Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data Lake Storage.
• Collaborate with cross-functional teams to gather requirements for data warehousing solutions and implement ETL processes using SSIS.
• Develop complex SQL queries to optimize database performance and troubleshoot issues in Cloudera Hadoop ecosystem.
• Lead junior engineers in design reviews, code reviews, and mentorship to ensure high-quality deliverables.

Desired Candidate Profile

• 5-10 years of experience in Data Engineering with expertise in ADF, Azure Databricks, Pyspark, Cloudera/Hadoop.
• Strong understanding of Data Warehousing concepts including star schema design and dimensional modeling.
• Proficiency in writing complex SQL queries for query optimization and troubleshooting purposes.