Big Data Administrator (Bank)

Responsibilities

• Provide L3 technical support for Big Data platforms, including delegation, troubleshooting, and resolution of complex/high-severity incidents.
• Manage and maintain Hadoop/HDP clusters, including provisioning, scaling, patching, decommissioning, HDFS, YARN, Spark, MapReduce, and HBase.
• Ensure 24x7 availability, resilience, SLA compliance, and production readiness of systems supporting critical payment, clearing, settlement, and regulatory workloads.
• Manage and optimize Apache Kafka for high-throughput, real-time payment event streaming, ensuring data consistency and fault tolerance.
• Administer AWS EMR and leverage AWS Cloud capabilities for scalable transaction processing, analytics, and reconciliation workloads.
• Manage OpenSearch/Elasticsearch and Kibana, including cluster administration, data pipelines, search, audit trails, and operational dashboards.
• Drive technical improvements, technology changes, lifecycle management, and transformation initiatives across Big Data services.
• Maintain technical documentation, review technology risks, support production readiness, and provide technical guidance/coaching to team and partner resources.

Requirements

• Experience in Big Data/Data Platform Engineering within enterprise environments.
• Strong hands-on expertise in the Hadoop ecosystem: HDFS, YARN, Spark, MapReduce, HBase, Hive, Pig, Oozie, Flume, and Sqoop.
• Strong experience with Apache Kafka, OpenSearch/Elasticsearch, Kibana, and high-throughput data/streaming environments.
• Strong experience with AWS EMR and good knowledge of AWS Cloud, with expertise in Linux administration and Shell/Python scripting.
• Strong knowledge of Kerberos, data security, access governance, cluster resilience, fault tolerance, and production platform operations.

Work Hours: 9:00 AM to 6:00PM or 2PM to 11PM (Shift rotation) + Support during non-office hours for critical incidents or on-call support requirements.

GMP Recruitment Services (S) Pte Ltd | EA Licence: 09C3051 | VO UYEN AI LINH | Registration No: R22109232