Gcp Data Engineer

Role & responsibilities

Must-Have

• Google Data Engineer (Overall 5+ Years with 3 years relevant hands-on experience)
• Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc.
• Good skills in Python Language, PYSPARK
• Good Skills in Linux
• Exposure to creation of CI-CD pipelines for promoting big data release deployments and designing log monitoring features.
• Excellent written and verbal communication skills in English
• The following skills are good-to-have, but not a requirement:

Responsibility of / Expectations from the Role

1

Data modelling/Data warehouse modernization/Cloud based data lakes

2

Create and maintain optimal data pipeline architecture

3

Define technical roadmap for data platform modernization and analysis and assessment of the existing data platforms

4

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

5

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Google cloud big data’ technologies.