Senior Data Engineer (AWS, Python/Java)

Senior Data Engineer (AWS, Python/Java)

Bengaluru

Onsite 5 days

25 LPA to 42 LPA

Must have skills: AWS, AWS Services, Python, Java, S3, Glue, Lambda, SQL, redshift, Docker

Roles & Responsibilities

This role offers an exciting opportunity to work on diverse projects, collaborating with cross functional teams to design, build, and optimize data pipelines and infrastructure.

Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes leveraging AWS services such as S3,
• Glue, EMR, Lambda, and Redshift.
• Collaborate with data scientists and analysts to understand data requirements and implement solutions that support analytics and machine learning initiatives.
• Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness.
• Implement data governance and security best practices to ensure compliance and data integrity.
• Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring.
• Stay abreast of emerging technologies and industry trends, recommending innovative solutions to enhance data engineering capabilities.

Ideal Candidate

1Strong Data Engineer (AWS) Profile

2Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8Mandatory (Education) – B.Tech / B.E./ M.Tech

9Mandatory (Notice Period) – Immediate joiners or candidates who can join within 2 weeks.

10Preferred (Experience 1)– Experience with Apache Airflow, Docker, and Kubernetes for pipeline orchestration and containerized data engineering workloads.

Interview Process

R1
R2
R3
HR Discussion

Pay: ₹2,500,000.00 - ₹4,200,000.00 per year

Ability to commute/relocate:

• Bengaluru, Karnataka (Bengaluru, Bengaluru Rural District): Reliably commute or planning to relocate before starting work (Required)

Application Question(s):

• Notice period

Experience:

• Senior Data Engineer (AWS, Python/Java): 4 years (Required)
• AWS: 4 years (Required)
• AWS Services: 4 years (Required)
• Python: 4 years (Required)
• S3: 4 years (Required)
• Bluebeam: 4 years (Required)
• Lambda: 4 years (Required)
• SQL: 4 years (Required)
• Redshift: 4 years (Required)
• Docker: 4 years (Required)

Location:

• Bengaluru, Karnataka (Bengaluru, Bengaluru Rural District) (Required)

Work Location: In person