Big Data Hadoop Administrator

Roles and Responsibilities :

• Manage Hadoop clusters across multiple environments, ensuring optimal performance and availability.
• Design, implement, and maintain large-scale data pipelines using Spark, Kafka, and other Big Data technologies.
• Collaborate with cross-functional teams to identify business requirements and develop solutions that meet those needs.
• Troubleshoot complex technical issues related to Hadoop infrastructure and application deployments.

Job Requirements :

• 4+ years of experience in Big Data administration with expertise in Hadoop Administration (HDFS, YARN, Oozie).
• Strong understanding of Spark programming language and its applications in big data processing.
• Experience working with messaging queues like Kafka for real-time data processing.
• Proficiency in managing large-scale distributed systems such as Hadoop.