Google Cloud Platform (GCP) Data Engineer

Job Description: Google Cloud Platform (GCP) Data Engineer

Location: Charlotte, NC – 300 S Brevard St

Schedule: Hybrid

Interview Process: In person Interview

Job Overview

We are seeking a hands-on Google Cloud Platform (GCP) Data Engineer with strong experience developing real-time streaming data pipelines and cloud-based data processing solutions. The ideal candidate will have expertise in GCP services, Python, Apache Beam, Java, Spring Boot, and SQL, with a focus on building scalable, secure, and high-performance data pipelines.

This is a specific use case requiring practical experience in real-time data streaming and Google Cloud data platforms. Candidates must demonstrate relevant hands-on experience rather than general cloud or data engineering knowledge.

Key Responsibilities

• Design, develop, and maintain scalable, secure data pipelines from on-premises systems to Google Cloud Platform.
• Build real-time streaming and batch data pipelines using GCP Dataflow, Pub/Sub, BigQuery, and Apache Beam.
• Develop reusable Python/Apache Beam transformation libraries for Slowly Changing Dimensions (SCD), data quality checks, and masking/tokenization.
• Design and develop high-performance Java applications using Java 8+, Spring Framework, and RESTful APIs.
• Implement real-time data ingestion and processing using Kafka and Google Cloud Pub/Sub.
• Develop and optimize SQL queries and data transformations in BigQuery.
• Build and maintain scalable microservices and integrate applications with cloud-based data platforms.
• Implement CI/CD pipelines using Jenkins, GitHub Actions, Gradle, and other DevOps tools.
• Perform coding, testing, debugging, deployment, and performance optimization.
• Document technical designs, data pipelines, and implementation solutions.

Required Qualifications

• Hands-on experience with Google Cloud Platform, particularly BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
• Strong experience developing real-time streaming data pipelines.
• Proficiency in Python and Apache Beam for data processing and transformation.
• Strong Java development experience, including Java 8+, multithreading, Spring Framework, and RESTful APIs.
• Experience with SQL and data transformation.
• Knowledge of microservices architecture and cloud-native applications.
• Experience with CI/CD tools such as Jenkins, GitHub Actions, and Gradle.
• Experience integrating on-premises data sources with GCP services.

Preferred Qualifications

• Experience with Cloud Composer and Cloud Functions.
• Exposure to Kafka-based streaming architectures.
• Experience implementing SCD patterns, data quality validations, and data masking/tokenization.
• Experience building reusable data processing frameworks and libraries.