Data engineer

Role & responsibilities

Azure Databricks Engineer Design, develop, and optimize scalable data engineering solutions using Databricks to support data integration, analytics, AI, and reporting requirements. Build and maintain reliable data pipelines, implement data transformation processes, and ensure data quality, performance, security, and governance across the data platform. Key Responsibilities Develop and maintain batch and real-time data pipelines using Databricks. Design and implement data transformation processes using PySpark and Spark SQL. Build and manage Delta Lake tables and Lakehouse architectures. Integrate data from multiple source systems, databases, and APIs. Optimize Databricks workloads for performance, scalability, and cost efficiency. Implement data quality validation, monitoring, and remed

Preferred candidate profile

Perks and benefits