Senior Platform Engineer

About the role

You will be responsible for operating and evolving an enterprise Data & AI Platform, with a strong focus on Cloudera, Hadoop platform operations, infrastructure automation, and reliability.

This is a hands-on platform/infrastructure role focused on ensuring the environment is scalable, secure, highly available, and performant. Strong Cloudera experience is a must.

Key responsibilities

• Administer and operate Cloudera CDP and Hadoop platforms in enterprise environments.
• Manage Hadoop components including HDFS, Hive, Spark, HBase, Impala, Iceberg, and Ozone.
• Perform cluster provisioning, configuration, scaling, patching, upgrades, and lifecycle management.
• Monitor platform health, availability, performance, and capacity.
• Troubleshoot infrastructure, cluster, storage, compute, and platform issues.
• Implement automation and Infrastructure-as-Code using Terraform, Ansible, Python, and Bash.
• Maintain CI/CD processes for platform configuration and infrastructure deployment.
• Implement monitoring, alerting, logging, and operational processes.
• Manage platform security including Kerberos, Ranger, encryption, and access controls.
• Coordinate platform changes and maintenance with infrastructure, network, and security teams.
• Maintain operational documentation, runbooks, and platform standards.
• Provide technical support for Cloudera and Hadoop environments.

About you

• At least 5 – 10 years of experience in platform engineering, infrastructure engineering, Big Data operations, or similar roles.
• Strong hands-on Cloudera CDP administration and operations experience.
• Strong knowledge of the Hadoop ecosystem and distributed platforms.
• Experience with cluster operations, performance tuning, troubleshooting, patching, and upgrades.
• Hands-on experience with Terraform and/or Ansible and infrastructure automation.
• Strong scripting skills in Python and/or Bash.
• Experience with on-prem infrastructure is highly preferred.
• Understanding of Kerberos, Ranger, encryption, authentication, and access control.
• Experience with monitoring, incident management, and root-cause analysis.
• Strong problem-solving and communication skills.

Important Notes:

Interested candidates kindly forward your CV to [email protected] (Yingjun Chen, Reg No. R1216690).  You may email this great opportunity to someone who would be a great fit.

All information will be kept strictly confidential. We regret to inform that only successful applicants will be contacted.

PeopleSearch Pte Ltd
EA License No. 16S8057