Big Data Developer

Role:

The role involves designing, developing and supporting scalable Big Data solutions and data pipelines, with strong focus on Scala, Java, Spark and Azure Databricks.

🔹 Responsibilities:

• Design and develop scalable data pipelines and applications

• Work on ETL/ELT, data processing and data integration

• Develop solutions using Scala, Java, Python and Spark

• Work with Azure Databricks and Azure services

• Participate in architecture and technical design decisions

• Develop and maintain automated tests and ensure code quality

• Support CI/CD, deployment and production activities

• Troubleshoot technical issues and provide solutions

• Collaborate with business and technical stakeholders

• Contribute to GenAI/LLM-based solutions where applicable

🔹 Mandate Skills:

• 4+ years of Big Data / Data Engineering experience

• Strong Scala & Java development experience

• Apache Spark / PySpark

• Azure & Azure Databricks

• Docker & Kubernetes

• GitLab / CI/CD

• Maven / Gradle

• Bash / Shell scripting

• JUnit / Mockito / Cucumber

• Postman / API testing

• Experience with ETL/data pipelines and distributed data processing