Aws Data Engineer

AWS Data Engineer

Location: Pune
Experience: 5+ Years
Work Mode: Hybrid / On-site
Employment Type: Full-Time

Job Overview

We are looking for an experienced AWS Data Engineer with strong hands-on expertise in Python, PySpark, AWS Data Services, and modern data technologies. The ideal candidate should have experience building scalable data pipelines, working with large datasets, cloud-native services, databases, and event-driven architectures.

Key Responsibilities

• Develop, maintain, and optimize scalable data pipelines using Python and PySpark.

• Work with Pandas, PyArrow, Parquet, and other data processing libraries.

• Design and implement data workflows using AWS cloud services.

• Work with modern data platforms and databases including Apache Iceberg, ClickHouse, Amazon Redshift, and DynamoDB.

• Build event-driven and serverless workflows using:

• AWS Lambda

• AWS Step Functions

• Amazon EventBridge

• Amazon SQS

• Amazon SNS

• Work with AWS EMR, AWS Glue, Amazon Athena, and Amazon S3 for data processing and analytics.

• Handle large-scale data processing and improve pipeline performance, reliability, and scalability.

• Explore and integrate Amazon Bedrock for AI/GenAI-based data solutions.

• Use AI-assisted coding tools to improve development productivity, code quality, and engineering efficiency.

• Troubleshoot data pipeline issues and participate in performance optimization.

• Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.

Required Skills

• 5+ years of experience in Data Engineering or a related role.
• Strong hands-on experience with Python and PySpark.
• Good knowledge of Pandas, PyArrow, and Parquet.
• Experience with Iceberg, ClickHouse, Redshift, and DynamoDB.
• Hands-on experience with AWS Lambda, Step Functions, EventBridge, SQS, SNS, EMR, Glue, Athena, and S3.
• Basic to hands-on understanding of Amazon Bedrock and GenAI technologies.
• Experience using AI-assisted coding tools.
• Strong understanding of data processing and pipeline optimization.
• Good problem-solving, analytical, and communication skills.

Preferred Candidate Profile

Candidates with strong hands-on experience in AWS Data Engineering, Python/PySpark development, cloud-native data pipelines, and modern AWS data services will be preferred.

Key Skills / Keywords

AWS Data Engineer | Python | PySpark | AWS | Pandas | PyArrow | Parquet | Apache Iceberg | ClickHouse | Redshift | DynamoDB | Lambda | Step Functions | EventBridge | SQS | SNS | EMR | Glue | Athena | S3 | Amazon Bedrock | GenAI | Data Pipelines | Data Engineering | AI-Assisted Coding