Senior Data Engineer

Data Engineer (5+ Years) | Python, PySpark, SQL | Contract, Remote/Hybrid

Our client is an IT consulting firm delivering premium services across IT Infrastructure, Big Data, Governance, Risk and Cyber. Our leadership brings 25+ years of experience in IT consulting and resourcing, and we place skilled consultants with leading clients across APAC and the US.

The Role
We are hiring Data Engineers for a 6+ month contract with a client project.

• Python/PySpark Data Engineer with GenAI exposure
• Data Engineer, core skills

Key Details

• Experience: 5+ years
• Contract: 6+ months
• Location: Remote (outside Chennai and Bangalore). Hybrid for Chennai, with 1 week per month onsite. Bangalore candidates can be placed at the client location.
• Notice period: Up to 30 days. Candidates who can join in 15-20 days are prioritised.
• Interview process: 3 rounds, including one mandatory face-to-face round

What You’ll Do

• Design, build and maintain scalable data pipelines using Python, PySpark and SQL
• Write and optimise complex SQL scripts for transformation and analysis
• Work with cloud data services on AWS, Azure or GCP
• Apply sound data engineering practices to ensure data quality, reliability and performance
• Communicate clearly with the client’s technical and business stakeholders
• (GenAI track) Work on solutions involving Generative AI and LLMs

Must-Have Skills

• 5+ years of overall experience in Data Engineering
• At least 4 years of hands-on experience in Python, PySpark and SQL
• Strong SQL scripting skills
• Solid understanding of data engineering concepts
• Hands-on experience with AWS, Azure or GCP services
• Excellent communication skills

Good to Have

• Knowledge of Generative AI and LLMs (an added advantage for the core track, required for the GenAI track)

How to Apply
Send your updated resume with your current notice period, current location and availability for a face-to-face interview.

Job Type: Full-time

Pay: ₹95,000.00 - ₹150,000.00 per month

Application Question(s):

• How many years of hands-on experience do you have in each of Python, PySpark and SQL separately? Describe the most complex PySpark pipeline you built, including data volume and your role?
• Describe a slow SQL query you optimised. What was the problem and what did you change?
• Which cloud platform (AWS, Azure or GCP) have you used for data engineering, and which services did you use for ingestion, storage and processing?
• Have you worked with LLMs or Generative AI in a data project? Briefly describe the use case, tools and your contribution.
• What is your notice period and current location? Are you comfortable with a mandatory face-to-face interview and, if you’re in Chennai, 1 week per month onsite?

Work Location: Hybrid remote in Chennai, Tamil Nadu 600096