Databricks Data Engineer

Databricks Engineer

Role Summary

As a Databricks Data Engineer, you will design, build, and optimize scalable data pipelines and solutions on the Databricks platform. You will collaborate with data scientists, analysts, and business stakeholders to ensure data is accessible, reliable, and secure for advanced analytics and machine learning initiatives.

Key Responsibilities

• Develop and maintain ETL/ELT pipelines using Databricks, Spark, and Delta Lake.
• Optimize data workflows for performance, scalability, and cost efficiency.
• Collaborate with cross-functional teams to integrate data from diverse sources.
• Implement data governance, security, and compliance best practices.
• Support advanced analytics and machine learning workloads on Databricks.

Required Skills & Qualifications

• 7+ Years of experience as Databricks Engineer
• Strong experience with Databricks, Apache Spark, and Delta Lake.
• Proficiency in Python, SQL, and PySpark.
• Hands-on experience with cloud platforms (Azure, AWS, or GCP).
• Knowledge of data warehousing concepts and modern architectures (Lakehouse).
• Familiarity with CI/CD pipelines, Git, and DevOps practices.
• Strong problem-solving and communication skills.
• Experience with MLflow and machine learning model deployment.