GCP Data Engineer

GCP Data Engineer

💰 £450/day (Inside IR35) 📍 London/Bristol (2/3 days pw onsite)

📅 1 year Contract

Our client is looking for an experienced GCP Data Engineer to join the Mobile Frameworks Lab within a major UK banking environment. You will work with BigQuery, Dataflow, Cloud Composer/Airflow, Cloud Storage, Cloud Run, DBT, SQL and Python/PySpark , supporting data solutions that help the bank understand and improve customer interactions across its digital and mobile channels.

Key Responsibilities

• Design, develop and maintain scalable GCP data pipelines using BigQuery, Dataflow and Cloud Storage.
• Develop data transformation and modelling solutions using DBT (Data Build Tool) .
• Write and optimise SQL, Python and/or PySpark for data processing and automation.
• Build and support data ingestion pipelines using Dataflow and/or Data Fusion .
• Implement and maintain workflow orchestration using Cloud Composer / Apache Airflow .
• Develop and support cloud-native data processing solutions using Cloud Run .
• Monitor, troubleshoot and optimise production data pipelines to ensure reliability and performance.
• Manage production incidents, change requests (CRs) and problem records (PRBs) .
• Work with LBG scheduling tools such as TWSD , alongside cloud-native orchestration.
• Develop modular, reusable and testable data transformation pipelines using DBT .
• Investigate data pipeline failures, perform root-cause analysis and implement permanent fixes.
• Support data quality, pipeline monitoring and operational improvements.
• Collaborate with engineering, platform and business teams to deliver reliable data solutions.

Essential Skills

• Strong hands-on Google Cloud Platform (GCP) experience.
• Strong experience with BigQuery, Dataflow, Cloud Composer/Airflow, Cloud Storage and Cloud Run .
• Proficiency in SQL, Python and/or PySpark .
• Hands-on experience with DBT (Data Build Tool) for data transformation and modelling.
• Experience with data ingestion patterns , including Dataflow or Data Fusion.
• Strong knowledge of data pipeline orchestration and scheduling .
• Experience with LBG schedulers such as TWSD .
• Proven experience supporting production data pipelines , including monitoring and troubleshooting.
• Experience managing incidents, change requests (CRs) and problem management (PRBs) .
• Strong analytical and problem-solving skills.

Desirable Skills

• Experience with AI and Machine Learning .
• Monitoring and observability tools such as Dynatrace and Splunk .
• Previous experience within Banking / Financial Services.
• Experience supporting data platforms in complex enterprise environments.

Please apply with your CV and we'll be in touch. Thank you!