Principal Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using ETL processes on GCP/AWS platforms.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality data solutions that meet business needs.
• Lead the development of complex data engineering projects from concept to delivery, ensuring timely completion within budget constraints.
• Ensure scalability, reliability, security and performance of all data systems by implementing best practices in design, architecture and testing.

Job Requirements :

• 9.8-16 years of experience in Data Engineering with expertise in AWS/GCP cloud technologies.
• Strong understanding of ETL process (Extract Transform Load) including SQL queries for data extraction and transformation.
• Proficiency in Python programming language with experience working with PySpark for big data processing.
• Experience leading a team of junior engineers or contributing as an individual contributor to deliver high-quality results.