Urgent Hiring For Data Engineer

Job Description: Big Data Engineer Scala, Spark, SQL & Kubernetes

Role Overview

We are looking for a skilled Big Data Engineer with experience in Scala, Apache Spark, SQL, and Kubernetes to design, develop, and optimize scalable data processing solutions. The ideal candidate should have an understanding of data file formats such as ORC and Avro, along with workflow orchestration tools like Apache Oozie or Apache Airflow.

Key Responsibilities

• Develop and maintain scalable data processing applications using Scala and Apache Spark.
• Write, optimize, and troubleshoot SQL queries for large-scale data processing.
• Deploy, manage, and support data processing workloads in Kubernetes environments.
• Work with data storage and serialization formats such as ORC and Avro.
• Use workflow scheduling and orchestration tools such as Apache Oozie or Apache Airflow.
• Monitor data pipelines, troubleshoot issues, and optimize performance.
• Collaborate with cross-functional teams to ensure data quality, reliability, and efficient processing.
• Follow best practices for code quality, performance optimization, and data pipeline development.

Required Skills

• Strong programming experience in Scala.
• Hands-on experience with Apache Spark for distributed data processing.
• Good knowledge of SQL and query optimization.
• Understanding or experience with Kubernetes.
• Knowledge of ORC and Avro data formats.
• Understanding or experience with Apache Oozie or Apache Airflow.
• Strong analytical, problem-solving, and troubleshooting skills.

Preferred Qualifications

• Experience working with large-scale data processing platforms.
• Familiarity with distributed computing a