Senior Data Engineer

Job Description: GCP Data Engineer

Experience: 4–10 Years

Roles & Responsibilities

• Design, develop, and implement scalable data processing solutions using Big Data technologies and distributed system s
• Strong hands-on experience with Python and PySpar k for developing efficient data pipelines and applications
• Develop and optimize complex SQL querie s, data models, and database solutions
• Analyze and improve performance of Apache Spark workload s through optimization techniques such as partitioning, caching, tuning, and resource optimization
• Design and implement various data processing pattern s including Batch Processing, Near Real-Time (NRT), and Real-Time data pipelines
• Understand business requirements and translate them into scalable data architecture and technical solution s
• Work with cloud-based data platforms and services, preferably Google Cloud Platform (GCP )
• Hands-on experience with GCP managed services such as: Google Cloud Storage, Dataproc, Dataflow, Pub/Sub, Cloud Functions, Cloud Composer, BigQuery, BigTable

.

Required Skills

• 4–8 years of experience i n Data Engineering / Big Data Engineering
• Strong programming experience i n Python, PySpark, SQL
• Hands-on experience wit h Spark, Hadoop ecosystem, and distributed computing
• Experience designing scalable data pipelines and cloud-based solution
• Strong exposure t o GCP data services and cloud architecture
• Good understanding of data modeling, ETL/ELT, and data integration pattern
• Experience with performance tuning and optimization of large-scale data processing workloads

Good to Have

• GCP certification(s)
• Experience in enterprise cloud migration projects
• Knowledge of DevOps practices and CI/CD automation
• Experience working in Agile development environments