Data Engineer

Job Description Databricks App Developer

Position

Databricks App Developer

Experience

5–8 Years

Location

Bangalore / Bengaluru

Work Mode

Hybrid

Employment Type

Full-Time

About the Role

We are looking for an experienced Databricks App Developer with 5–8 years of experience in data engineering and application development. The ideal candidate should have strong hands-on experience with Databricks, PySpark, Python, SQL, Apache Spark, Delta Lake, and cloud-based data platforms.

The candidate will be responsible for developing, optimizing, and maintaining data applications and solutions using the Databricks Lakehouse platform.

Key Responsibilities

• Design, develop, and maintain data applications and solutions using Databricks.
• Develop scalable data pipelines using PySpark, Python, and SQL.
• Work extensively with Apache Spark and Delta Lake.
• Develop and optimize ETL/ELT workflows within Databricks.
• Work with Databricks notebooks, workflows/jobs, clusters, and SQL Warehouses.
• Build and optimize data processing applications for performance and scalability.
• Implement data transformation, cleansing, validation, and integration processes.
• Work with Unity Catalog for data governance, access control, and data management.
• Troubleshoot performance, data quality, and application-related issues.
• Collaborate with Data Engineers, Architects, Developers, and Business teams.
• Follow coding standards, CI/CD practices, testing, and deployment processes.
• Participate in code reviews and contribute to technical documentation.

Mandatory Skills

• Databricks
• PySpark
• Python
• SQL
• Apache Spark
• Delta Lake
• Databricks Workflows / Jobs
• Databricks Notebooks
• Experience with cloud platforms – Azure / AWS / GCP
• Good understanding of data engineering concepts
• Strong debugging and problem-solving skills

Good to Have

• Unity Catalog
• Delta Live Tables / Lakeflow Declarative Pipelines
• Databricks SQL
• Azure Data Factory / AWS Glue
• CI/CD and DevOps
• Git
• REST APIs
• Data governance and security
• Experience in developing applications on the Databricks Lakehouse platform

Candidate Profile

• 5–8 years of overall IT experience.
• Strong hands-on experience in Databricks and PySpark.
• Good programming experience in Python and SQL.
• Strong understanding of distributed data processing using Spark.
• Experience developing and optimizing production-grade data pipelines/applications.
• Good communication and collaboration skills.
• Ability to work independently as well as within a team.