Senior Data Platform Engineer

We are looking for an experienced Data Platform Engineer with strong hands-on expertise in Cloudera Data Platform (CDP) to join our team.

The ideal candidate should be comfortable working across both Data Engineering and Data Platform Engineering , with proven experience supporting enterprise-scale Big Data production environments.

⚠️ Mandatory Requirement: Practical, hands-on Cloudera experience is essential. Profiles without relevant Cloudera experience will not be considered.

🔹 Key Responsibilities

• Design, develop, maintain, and support ETL/ELT pipelines using Apache NiFi, Spark/PySpark, Oozie/Airflow, and related technologies.
• Support and manage enterprise Cloudera (CDP) production environments.
• Monitor platform health, availability, performance, and capacity.
• Troubleshoot complex platform, infrastructure, application, and data-related issues.
• Handle production incidents, perform Root Cause Analysis (RCA), and implement permanent fixes.
• Optimize Spark jobs, SQL queries, and overall platform performance.
• Support Apache Kafka and real-time data processing workloads.
• Participate in platform upgrades, patching, maintenance, and configuration changes.
• Automate operational activities using Shell Scripting and Python.
• Maintain technical documentation, operational runbooks, and support procedures.
• Take end-to-end ownership of assigned tasks and ensure timely resolution.

🔹 Mandatory Technical Skills

✅ Cloudera Data Platform (CDP)

✅ Hadoop Ecosystem

✅ Apache Hive & Impala

✅ Apache NiFi

✅ Apache Spark / PySpark

✅ Apache Kafka

✅ Apache Iceberg

✅ Linux & Shell Scripting

✅ SQL & Python

✅ Production Support & Troubleshooting

✅ Performance Tuning & Optimization

🔹 Good to Have

• Docker & Kubernetes
• Cloudera Data Services (CDS)
• Data Modelling

🔹 What We're Looking For

✔ Strong analytical and problem-solving abilities

✔ Excellent troubleshooting and debugging skills

✔ Ownership, accountability, and a proactive approach

✔ Good communication and technical documentation skills

✔ Ability to work independently and collaborate with cross-functional teams

✔ Willingness to learn and adapt to evolving technologies

📩 Interested?

If you have strong hands-on Cloudera CDP experience and enjoy working on challenging enterprise Big Data environments, we'd love to hear from you!

Interested candidates can share their updated CV or connect with me directly.