Senior Data Engineer - GCP

Role Overview
We are looking for a Senior Data Engineer (GCP) with strong hands-on experience in building and optimizing scalable data pipelines on Google Cloud Platform. This role requires deep technical expertise in data engineering, pipeline development, and cloud-native solutions, with the ability to work closely with cross-functional teams to deliver high-quality data systems.

Key Responsibilities

• Design, build, and optimize scalable batch and real-time data pipelines.
• Develop and maintain ETL/ELT workflows for diverse data sources.
• Build robust data ingestion frameworks and support data migration initiatives.
• Manage workflow orchestration, scheduling, and pipeline dependencies.
• Ensure efficient and reliable data processing across environments.
• Optimize query performance and data processing jobs.
• Implement data validation, quality, and reconciliation frameworks.
• Monitor pipelines to ensure availability, reliability, and performance.
• Collaborate with cross-functional teams to translate business requirements into solutions.
• Contribute to data architecture and design discussions.
• Follow best practices for version control, CI/CD, and deployments.
• Ensure compliance with security, governance, and data standards.
• Support production systems through troubleshooting and continuous improvement.

Must-Have Skills

• 6-8 years of experience in data engineering.
• Strong hands-on experience with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage).
• Experience with Spark / PySpark and SQL optimization.
• Hands-on with Cloud Composer (Airflow).
• Strong understanding of data modeling and pipeline design.
• Experience with batch + streaming data processing.
• Familiarity with CI/CD and Git-based workflows.
• Strong problem-solving and analytical skills.

Preferred Qualifications

• Experience with Kafka or real-time streaming systems.
• Exposure to data warehousing concepts and BigQuery optimization.
• Experience with Terraform or Infrastructure-as-Code.
• Knowledge of data governance and security practices.
• GCP certifications (Professional Data Engineer preferred).

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.