Big Data Administrator

We are looking for an experienced Hadoop Administrator to manage, maintain, and optimize our big data infrastructure. The ideal candidate will be responsible for cluster administration, performance tuning, security, and ensuring high availability of Hadoop ecosystems.

Key Responsibilities:

• Install, configure, and maintain Hadoop clusters (Cloudera / Hortonworks / Apache) across development, test, and production environments.
• Monitor cluster health, performance, capacity, and resource utilization; troubleshoot and resolve issues proactively.
• Manage HDFS, YARN, and related ecosystem components (Hive, HBase, Spark, Sqoop, Oozie, Kafka, Zookeeper).
• Implement and manage cluster security using Kerberos, Ranger, Sentry, and LDAP integration.
• Perform capacity planning, cluster scaling, commissioning, and decommissioning of nodes.
• Configure high availability, backup, disaster recovery, and data replication strategies.
• Automate routine administration tasks using shell scripting, Python, or Ansible.
• Apply patches, upgrades, and version migrations with minimal downtime.
• Manage user access, quotas, and multi-tenancy across the cluster.
• Collaborate with data engineering, DevOps, and application teams to support workloads.

Required Skills:

• Strong hands-on experience administering Hadoop clusters (Cloudera CDH/CDP, Hortonworks HDP, or Apache Hadoop).
• In-depth knowledge of HDFS, YARN, MapReduce, and the broader Hadoop ecosystem.
• Experience with cluster security (Kerberos, Ranger/Sentry, TLS/SSL).
• Proficiency in Linux/Unix administration.
• Scripting skills in Shell, Python, or Perl.
• Familiarity with monitoring tools (Cloudera Manager, Ambari, Grafana, Nagios).
• Understanding of networking, storage, and performance tuning concepts.