Data Engineer

Position – Azure Data Engineer

Location : Chennai (WFO)

Experience : 7-10 Years

Shift : 2.00 PM to 11.00 PM (UK shift) and 5:30 PM to 2:30 AM (US Shift) – Rotational Basis

Max CTC – 20 LPA

Required Skills – Over all experience 7 Years (Data Engineer Experience should be 5+ years)

ADF – Mandate****Microsoft Fabric – Mandate
PySpark – Mandate
Medallion Data Architecture
CI/CD pipelines

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, load data from various sources into Azure Storage.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
• Develop CI/CD pipelines using PySpark on Oracle ADF Fabric to automate the deployment of data models and ETL processes.
• Troubleshoot issues related to data quality, performance, security, scalability of the deployed systems.

Job Requirements :

• 7-15 years of experience in designing and developing large-scale data engineering projects using Azure Data Factory (ADF).
• Strong understanding of Python programming language and its applications in big data processing.
• Experience with Oracle ADF Fabric for building complex workflows and integrations.