GCP Data Engineer

Job Description: GCP Data Engineer

Role Overview

We are seeking experienced GCP Data Engineers to design, build, and optimize scalable data pipelines and analytics solutions on Google Cloud Platform (GCP). The role requires strong expertise in Python, SQL, PySpark, Dataproc, and Dataflow to deliver enterprise-grade data engineering capabilities.

Key Responsibilities

• Data Pipeline Development: Build and maintain ETL/ELT pipelines using Dataflow, Dataproc, and PySpark.
• Data Modeling: Design efficient schemas and implement partitioning/clustering strategies in BigQuery.
• Workflow Orchestration: Automate and monitor workflows using Cloud Composer (Airflow).
• Data Integration: Connect diverse sources (databases, APIs, cloud storage) into unified pipelines.
• Performance Optimization: Tune queries, optimize jobs, and ensure cost-efficient execution.
• Collaboration: Partner with architects, analysts, and business stakeholders to deliver actionable insights.
• Production Support: Troubleshoot issues, ensure pipeline reliability, and follow CI/CD best practices.

Mandatory Skills

• Hands-on expertise in Google Cloud Platform (GCP) services: Dataflow, Dataproc, BigQuery, Pub/Sub, Cloud Storage.
• Strong programming skills in Python, SQL, PySpark.
• Experience with ETL/ELT pipelines, data modeling, and warehousing concepts.
• Familiarity with CI/CD pipelines, Git, and Agile methodology.

Preferred Skills

• Experience with Cloud Composer (Airflow) for orchestration.
• Exposure to Apache Beam, Hadoop ecosystem, and shell scripting.
• Multi-cloud experience (AWS/Azure/GCP).
• Understanding of data governance frameworks.

Candidate Profile

• Experience: 5–10 years in Data Engineering (minimum 2+ years on GCP).
• Education: Bachelor’s/Master’s in Computer Science, IT, or related field.
• Location: Open to major tech hubs (e.g., Bengaluru, Chennai).
• Employment Type: Full-time, permanent.