Databricks Data Engineer | Azure | PySpark

Role & responsibilities

Job Description

Tiger Analytics is a global AI and Analytics company helping Fortune 1000 organizations build data-driven solutions using modern cloud technologies.

We are looking for skilled Databricks Data Engineers with strong expertise in Azure Data Engineering to build scalable, high-performance data platforms and pipelines.

Key Responsibilities

• Design and develop scalable ETL/ELT pipelines using Azure Databricks.
• Build data ingestion and transformation frameworks for batch and streaming data.
• Develop data pipelines using PySpark, Azure Data Factory, and ADLS Gen2.
• Implement Delta Lake and Lakehouse architecture.
• Optimize Spark jobs for performance and scalability.
• Build logging, monitoring, and exception handling frameworks.
• Collaborate with Data Architects, Data Scientists, and Business teams.

Required Skills

• Azure Databricks
• PySpark
• Python
• SQL
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS Gen2)
• Delta Lake
• Spark SQL
• ETL/ELT Development
• Data Engineering

Preferred Skills

• Azure Synapse Analytics
• Unity Catalog
• Delta Live Tables (DLT)
• Kafka/Event Hubs
• Azure DevOps
• CI/CD
• Databricks Workflows

Experience
46 Years

Employment Type
Full-Time

Preferred candidate profile