Data Engineer - Databricks, PySpark, Python

Role: Data Engineer - Databricks, PySpark, Python

Experience: 7-12 Years
Location: PAN India

Job Summary-

We are looking for a skilled Databricks Data Engineer with strong expertise in Databricks, Python, and PySpark to build and maintain scalable data pipelines, data lakes, and cloud-based analytics solutions. The ideal candidate should have experience in big data processing, ETL/ELT development, data warehousing, and cloud-native data platforms.

Roles & Responsibilities-

• Design, develop, and optimize data pipelines using Databricks and PySpark.
• Build scalable ETL/ELT solutions for structured and unstructured data.
• Develop data transformation workflows using Python and Spark.
• Work with large datasets in Data Lakes and Data Warehouses.
• Optimize Databricks jobs and Spark performance.
• Implement Delta Lake architecture and data governance practices.
• Integrate data from multiple sources and enterprise applications.
• Develop and maintain CI/CD pipelines for data engineering projects.
• Collaborate with Data Scientists, Analysts, and Business stakeholders.

Mandatory Skills -

Databricks | Python | PySpark | SQL | Spark SQL | Delta Lake | ETL/ELT | Data Warehousing | Azure Data Factory | GitHub | CI/CD | Azure DevOps | Data Modeling.