Lead Data Engineer - GCP

We are looking for a Senior GCP Data Engineer with 6+ years of experience in designing, developing, and maintaining scalable data engineering solutions on Google Cloud Platform (GCP) . The ideal candidate should have strong hands-on expertise in Python, SQL, data pipelines, and GCP data services .

Key Responsibilities

• Design and develop scalable and reliable data pipelines using GCP services.

• Develop data processing and transformation solutions using Python and SQL .

• Build and optimize ETL/ELT pipelines for large-volume datasets.

• Work with business and technical teams to understand data requirements and deliver robust solutions.

• Perform data modeling, data validation, and performance optimization.

• Monitor and troubleshoot data pipelines and resolve production issues.

• Implement data quality, security, and governance best practices.

• Participate in code reviews and contribute to technical design and architecture discussions. Qualifications

• 6+ years of experience in Data Engineering.

• Strong hands-on experience with Google Cloud Platform (GCP) .

• Strong programming experience in Python .

• Strong expertise in SQL , including complex queries, joins, CTEs, window functions, and query optimization.

• Experience developing ETL/ELT data pipelines .

• Hands-on experience with one or more GCP services such as:

  • BigQuery
  • Cloud Storage (GCS)
  • Cloud Composer / Airflow
  • Dataflow
  • Pub/Sub
  • Dataproc

• Experience with Apache Spark / PySpark is preferred.

• Good understanding of data warehousing, data modeling, and distributed data processing.

• Experience with Git and CI/CD practices.

Nice to Have

• Experience with Terraform or Infrastructure as Code.
• Exposure to GCP Dataform .
• Experience with real-time/streaming data pipelines.
• Knowledge of cloud security and IAM.
• Experience working in Agile environments.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.