Senior Data Engineer

Job Summary

We are looking for a highly skilled Data Engineer with strong expertise in Azure Databricks and good understanding DevOps Practices. The ideal candidate will design, build, and optimize large-scale data pipelines and data warehousing solutions on cloud platforms.

Job Details

Location: Bangalore (Hybrid)

Experience: 2 - 4 Years

Employment Type: Full-Time

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python
• Perform distributed data processing using PySpark on Azure Databricks
• Implement and manage Delta Lake, Databricks cluster configurations
• Develop ETL/ELT workflows for structured and unstructured data
• Optimize data warehouse performance through efficient schema design and query tuning
• Work with orchestration tools like Apache Airflow for scheduling and workflow management
• Collaborate with cross-functional teams to deliver high-quality data solutions
• Ensure data reliability, governance, and best practices across platforms

Required Skills

• Advanced proficiency in Python for data engineering
• Strong hands-on experience with PySpark
• Deep expertise in Azure Databricks, including Delta Lake and cluster management
• Strong experience with SQL for analytics and data warehousing
• Experience with data warehousing platforms such as:
  • Snowflake
  • Azure Synapse Analytics
  • AWS Redshift
• Working knowledge of cloud platforms : Azure

Good to Have

• Experience with NoSQL databases (e. g. , MongoDB)
• Exposure to big data services like Azure Data Factory
• Devops : CI/CD pipelines, Docker, Kubernetes

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.