Hadoop Scala Developer

Locations: Charlotte NC & New Jersey

Must Have Technical/Functional Skills

Primary Skill: Hadoop, Scala, Shell scripting

Secondary: Java, Spring Boot

Roles & Responsibilities

• Design, develop, and maintain large-scale Big Data solutions using Hadoop ecosystem technologies. Develop data ingestion, transformation, and processing frameworks using Scala, Spark, and Hadoop.

• Create and maintain Shell scripts for automation, monitoring, deployment, and operational support.

• Build reusable and scalable backend services using Java and Spring Boot.

• Develop and optimize Spark applications for batch and real-time data processing.

• Design and implement RESTful APIs and microservices using Spring Boot.

• Work with HDFS, Hive, Sqoop, Kafka, Oozie, and other Hadoop ecosystem components.

• Perform performance tuning and optimization of Hadoop and Spark jobs.

• Troubleshoot production issues and provide L2/L3 support for critical applications.

• Collaborate with business analysts, architects, DevOps teams, and other stakeholders.

• Participate in code reviews, unit testing, CI/CD implementation, and release activities.

• Ensure compliance with enterprise security, governance, and data quality standards.