Azure Data Engineer

Hiring for One of the topmost MNC!!

ROLE: Azure Data Engineer

Exp: 5 to 8 YRS

Location: Bengaluru, Chennai

Work mode: 5 Days work from office

Job Summary:

We are looking for an experienced Azure Data Engineer with strong expertise in Azure Databricks to design, develop, and maintain scalable data pipelines and data solutions. The ideal candidate should have hands-on experience with Azure data services, Databricks, PySpark, SQL, and ETL/ELT processes

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using Azure Databricks.
• Develop data transformation and processing solutions using PySpark and SQL.
• Build and optimize ETL/ELT pipelines using Azure data services.
• Work with Azure Data Factory (ADF) for pipeline orchestration and data integration.
• Implement data ingestion from various sources including databases, APIs, files, and cloud storage.
• Work with Azure Data Lake Storage (ADLS Gen2) for storing and managing large datasets.
• Develop and maintain Delta Lake tables and implement data lakehouse solutions.
• Optimize Databricks jobs, Spark workloads, SQL queries, and data pipelines for performance and cost.
• Implement data quality, validation, monitoring, and error-handling processes.
• Collaborate with data analysts, data scientists, architects, and application teams to understand data requirements.
• Follow data engineering best practices around security, governance, version control, and deployment.
• Troubleshoot production data pipeline issues and provide timely resolutions.

--
Thanks & Regards
Nikhil C
IT Staffing Analyst
Black and White Business Solutions Pvt.Ltd.
Bangalore,Karnataka,India.
[email protected]|www.blackwhite.in