Azure Data Engineer

Roles and Responsibilities :

• Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions.
• Collaborate with cross-functional teams to gather requirements for data processing needs and design scalable architectures for big data workloads on Microsoft Azure platform.
• Develop machine learning models using PySpark and Python libraries such as scikit-learn or TensorFlow to solve complex business problems.
• Troubleshoot issues related to ADF workflows, ML models, and other Azure services.

Job Requirements :

• 4-7 years of experience in a similar role as an AI Data Engineer expertise in artificial intelligence, generative AI, large language modeling, retrieval augmented generation.
• Strong proficiency in working with Microsoft Azure platform including Data Bricks, Databricks Notebooks, Function Applications etc. .
• Experience with developing machine learning models using popular Python libraries like scikit-learn or TensorFlow.