Senior GCP Data Engineer

Dear Professionals,

Greetings from Tata Consultancy Services (TCS)!!!

Job Title : Senior GCP Data Engineer

Experince : 6-10 Years

Location: Hyderabad/Bangalore

Mode of Interview : Virtual

Expert-level knowledge of Google Cloud Platform services including:

BigQuery – advanced SQL, partitioning, optimization, and cost control

Dataflow (Apache Beam) – large-scale batch and streaming data pipelines

Dataproc – Spark and Hadoop-based distributed processing

Cloud Composer (Airflow) – workflow orchestration, scheduling, and dependency management

Pub/Sub – event-driven, real-time ingestion

Cloud Storage (GCS) – data lake setup, lifecycle management, access control

Strong proficiency in Python (Pandas, PySpark, Beam SDK) and SQL for data wrangling and transformation.

Expertise in ETL/ELT design , data lake/data warehouse/lakehouse architecture .

Experience with DevOps & CI/CD using tools such as GitHub Actions, Jenkins, or Cloud Build .

Hands-on with Terraform or Deployment Manager for Infrastructure as Code (IaC).

Solid understanding of GCP IAM , VPC , security policies , and encryption mechanisms .

Familiarity with data quality, metadata, lineage, and cataloging tools (e.g., Data Catalog).

Proficiency in cost governance , performance tuning , and resource monitoring (Cloud Monitoring/Logging).

Knowledge of modern data frameworks and data integration between systems like Kafka, Snowflake, or Looker.