Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Python, Spark, SQL and AWS.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time.
• Develop scalable data processing architectures to handle big data volumes and ensure data quality through testing and monitoring.
• Troubleshoot issues related to pipeline failures or performance problems.

Job Requirements :

• 3-5 years of experience in Data Engineering with expertise in Python programming language.
• Strong understanding of Spark for distributed computing tasks such as ETL processes.
• Proficiency in SQL for querying relational databases like MySQL or PostgreSQL.
• Experience working with cloud-based platforms like AWS for deploying applications.