Data Engineer- GCP, Scala & Kafka

Role: Data Engineer / Senior Data Engineer GCP, Scala & Kafka
Experience: 6-10 Years
Location: Pan India

Virtual Interview: 01-Oct-26

Job Summary

We are seeking an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP), Scala, and Apache Kafka to build and maintain scalable, high-performance data processing solutions. The ideal candidate should have experience in real-time data streaming, distributed systems, cloud-native architectures, and large-scale data platforms.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Scala.
• Build and manage real-time streaming solutions using Apache Kafka.
• Develop data ingestion, transformation, and processing frameworks on GCP.
• Work with BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub services.
• Optimize data processing workloads for performance, scalability, and reliability.
• Collaborate with Data Scientists, Analysts, and Application Teams to support business requirements.
• Implement monitoring, logging, and troubleshooting for data pipelines.
• Ensure data quality, governance, security, and compliance standards.

Required Skills

• 6-10 years of overall IT experience.

• Strong hands-on experience in Scala programming.

• Experience with Apache Kafka, Kafka Streams, Kafka Connect, and event-driven architectures.

• Hands-on experience with Google Cloud Platform (GCP) services such as:

• BigQuery

• Dataflow

• Dataproc

• Pub/Sub

• Cloud Storage

• Composer

• Experience in ETL/ELT and real-time data processing.

• Strong SQL and database skills.

• Knowledge of Spark and distributed processing frameworks.

• Experience with CI/CD, Git, and DevOps practices.

Preferred Skills

• Spark/Scala development.
• GCP certification.
• Experience with Kubernetes and Docker.
• Exposure to Airflow/Cloud Composer.
• Knowledge of Data Lake and Data Warehouse concepts.