Senior GCP Data Engineer

Responsibilities:

Data Engineering & Architecture:

• Design, develop, and maintain scalable data platforms and pipelines using Google Cloud services.

• Implement data ingestion, transformation, and orchestration workflows using: BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Cloud SQL / PostgreSQL

• Define data models, partitioning strategies, and storage architectures optimized for large-scale analytics.

• Implement batch and near real-time data processing solutions.

BigQuery Engineering:

• Design, optimize, and maintain BigQuery datasets, tables, views, and data marts.
• Develop complex BigQuery SQL solutions for analytics and operational reporting.
• Optimize query performance, storage costs, partitioning, clustering, and workload management.
• Establish best practices for BigQuery governance, security, and performance monitoring.

PostgreSQL Engineering:

• Design and develop PostgreSQL database solutions on GCP.
• Create and optimize database schemas, indexes, stored procedures, and PL/pgSQL code.
• Perform database performance tuning, capacity planning, and troubleshooting.
• Support migration and modernization of legacy databases to PostgreSQL.

Cloud Migration & Modernization:

• Support migration of legacy Oracle workloads to PostgreSQL and BigQuery.
• Assess existing database architectures and recommend modernization approaches.
• Collaborate with application teams to refactor data solutions for cloud-native environments.
• Ensure data integrity, security, and operational readiness during migrations.

Data Governance & Security:

• Implement IAM controls, encryption, auditing, and data protection standards.
• Apply data governance and compliance requirements across the cloud platform.

Collaboration:

• Participate in architecture reviews, code reviews, and engineering standards definition.
• Collaborate with product owners, architects, analysts, and platform teams to deliver business value.

Skills

Must have:

• Minimum 5 years of hands-on experience working with relational and analytical databases
• Minimum 1 year of hands-on experience with Google BigQuery (GCP)
• Proven expertise in Google BigQuery (GCP), with the ability to build, manage, and optimize data solutions in a cloud environment.
• Proven expertise in PostgreSQL administration and development, including schema design, data integrity, performance monitoring, and troubleshooting.
• Proficiency with GitHub for version control and collaborative development.

Nice to have:

• Experience migrating Oracle databases to PostgreSQL and/or BigQuery.
• Oracle SQL and PL/SQL knowledge.
• Experience with Ora2pg or similar migration tooling.
• Google Cloud Professional Data Engineer certification.
• Google Cloud Professional Cloud Architect certification.
• Experience with Terraform.
• Experience with containerized deployments using Docker and Kubernetes (GKE).
• Experience with Airflow / Cloud Composer.
• Experience with data governance, metadata management, and data quality frameworks.
• Experience with Google Cloud Dataflow for building and managing data processing pipelines.
• Experience with Google Cloud Dataproc for big data processing and analytics workloads.
• Experience with Google Cloud Pub/Sub for event-driven architectures and real-time data streaming.
• Python for data engineering, automation, data processing, and scripting tasks.