Python Databricks Engineer

We are looking for an experienced Python Databricks Engineer with a minimum of 5 years of experience in data engineering and development. The ideal candidate should have strong hands-on experience with Python, Databricks, Apache Spark, SQL, and data pipeline development. The candidate will be responsible for designing, developing, optimizing, and maintaining scalable data pipelines and data processing solutions using the Databricks platform. Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python, Databricks, and Apache Spark.
• Develop and optimize PySpark applications for large-scale data processing.
• Build and maintain ETL/ELT pipelines for structured and unstructured data.
• Work with Databricks notebooks, workflows, jobs, clusters.
• Develop complex SQL queries for data transformation, validation, and analysis.
• Implement data ingestion from various sources into Databricks.
• Perform data cleansing, transformation, aggregation, and integration.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.