GCP Data Engineer - H

Desired Competencies (Technical/Behavioral Competency)

• Google Data Engineer (Overall 5+ Years with 3 years relevant hands-on experience)
• Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc.
• Good skills in Python Language, PYSPARK
• Good Skills in Linux
• Exposure to creation of CI-CD pipelines for promoting big data release deployments and designing log monitoring features.
• Excellent written and verbal communication skills in English
• The following skills are good-to-have, but not a requirement:

Responsibility of / Expectations from the Role

• Data modelling/Data warehouse modernization/Cloud based data lakes
• Create and maintain optimal data pipeline architecture
• Define technical roadmap for data platform modernization and analysis and assessment of the existing data platforms
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Google cloud big data technologies.