Big Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Python and Spark on Azure cloud platform.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions that meet business needs.
• Develop complex data models and algorithms to solve real-world problems in the banking industry.
• Troubleshoot issues related to data processing, storage, and retrieval from Snowflake databases.

Job Requirements :

• 6-8 years of experience in Big Data engineering with expertise in Python programming language.
• Strong understanding of Spark (Scala) for distributed computing tasks.
• Proficiency in Microsoft Azure platform for cloud-based deployment of applications.
• Experience working with Snowflake database management system.