Python,Pyspark,AWS

Roles and Responsibilities

• Design, develop, test, deploy, and maintain large-scale data processing pipelines using AWS services such as S3, Lambda, Step Functions, etc.
• Develop high-quality code in Python using PySpark for big data processing tasks.
• Ensure scalability, reliability, and performance of deployed applications by monitoring logs, metrics, and other relevant KPIs.

Desired Candidate Profile

• 6-8 years of experience in backend development with expertise in AWS services (S3, Lambda).
• Strong proficiency in Python programming language with hands-on experience working with PySpark for big data processing tasks.
• Experience building scalable architectures on cloud platforms like AWS; knowledge of containerization using Docker is an added advantage.