Azure Data Engineer with snowflake and Python

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Snowflake.
• Collaborate with cross-functional teams to understand business requirements and design scalable solutions for big data processing using Python scripts.
• Develop complex SQL queries on Azure SQL Database to optimize database performance and troubleshoot issues.
• Implement event-driven architecture patterns using Azure Functions to integrate with other systems.

Job Requirements :

• 6-9 years of experience in designing and developing large-scale data pipelines using ADF.
• Strong understanding of Python programming language for scripting tasks such as ETL processes.
• Experience working with Snowflake as a cloud-based relational database management system.
• Proficiency in writing efficient SQL queries on Azure SQL Database.