Azure Data Engineer_F2F in Bangalore_10-Oct Sat_Permanent

CGI Drive F2F Interview

Position: Associate Data Engineer (ADE)
Skills: Python, PySpark, Databricks
Experience: 810 Years
Location: Bangalore

Interview Mode: Face-to-Face (F2F)
Interview Date: 10th October

Job Description

We are looking for experienced Data Engineers with strong hands-on experience in Python, PySpark, and Databricks to join our data engineering team.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and PySpark.
• Develop and optimize data processing workflows on Databricks.
• Work with large datasets and implement efficient ETL/ELT processes.
• Develop data transformation and integration solutions using PySpark.
• Write clean, reusable, and optimized Python code.
• Perform data validation, troubleshooting, and performance tuning.
• Work with stakeholders to understand data requirements and deliver reliable solutions.
• Monitor data pipelines and troubleshoot production issues.
• Follow best practices for coding, testing, deployment, and documentation.
• Collaborate with data engineers, architects, analysts, and business teams.

Required Skills

• 8–10 years of overall experience in Data Engineering.
• Strong hands-on experience in Python.
• Strong experience with PySpark and distributed data processing.
• Good experience working with Databricks.
• Strong understanding of ETL/ELT concepts and data pipelines.
• Good knowledge of SQL and data manipulation.
• Experience in performance tuning and optimization of Spark jobs.
• Strong debugging and problem-solving skills.
• Good communication and collaboration skills.

Preferred Skills

• Experience with Azure/AWS/GCP data services.
• Knowledge of Delta Lake and Databricks workflows.
• Experience with CI/CD and version control such as Git.
• Understanding of data warehousing and cloud-based data platforms.

Candidate Details

• Experience: 8–10 Years
• Location: Bangalore
• Interview: F2F
• Date: 10th October
• Primary Skills: Python, PySpark, Databricks