Data Engineer

Role & responsibilities

Key Responsibilities

• Design, develop, and maintain scalable and optimized ETL/ELT data pipelines
• Build and enhance data processing solutions using Databricks, PySpark, Python, and SQL
• Work on integration of multiple source systems with varying data throughput and complexity
• Perform code optimization, performance tuning, and troubleshooting of data workflows
• Collaborate with cross-functional teams including business analysts, architects, QA, and reporting teams
• Ensure data quality, integrity, governance, and compliance standards are maintained
• Participate in code reviews, release planning, deployment activities, and production support
• Create and maintain technical documentation, design artifacts, and operational runbooks
• Identify risks proactively and propose mitigation approaches
• Support continuous improvement initiatives and adoption of best engineering practices

Mandatory Skills

• Strong hands-on experience in:
• Databricks
• PySpark
• Python
• SQL
• Git/version control
• Experience working on projects involving multiple integration systems and high-volume data processing
• Strong expertise in code optimization and performance tuning
• Experience in building scalable data engineering solutions and reusable frameworks
• Minimum 2+ years of experience delivering one or more end-to-end data engineering projects

Good to Have Skills

• Data Modelling
• Dimensional Modelling
• Schema Design
• Experience with reporting/visualization tools such as Microsoft Power BI
• Exposure to cloud platforms such as AWS, Azure, or GCP
• Understanding of CI/CD pipelines and DevOps practices
• Experience working in Agile/Scrum delivery environments
• Experience in DLT (Delta Live Tables)

Soft Skills

• Strong attention to detail to ensure data accuracy and integrity
• Excellent communication and comprehension skills
• Clear and structured documentation practices
• Flexibility and adaptability to changing project environments and priorities
• Strong planning and prioritization skills with ability to meet timelines
• Ability to proactively identify risks and provide mitigation approaches
• Good conflict resolution and stakeholder collaboration skills
• Ownership mindset with proactive and independent execution capabilities
• Positive attitude with strong problem-solving approach

Experience Guidelines

• Senior Developer Data Engineer
• 36 years of relevant experience
• Strong architecture understanding and optimization skills
• Ability to mentor junior team members and drive delivery ownership

Preferred Qualifications

• Bachelors or Masters degree in Computer Science, Information Technology, Engineering, or related field
• Relevant Databricks or cloud certifications are an added advantage

Preferred candidate profile

Experience Guidelines

• Senior Developer Data Engineer
• 36 years of relevant experience
• Strong architecture understanding and optimization skills
• Ability to mentor junior team members and drive delivery ownership

Perks and benefits

• Hybrid Work
• Great working Culture