Big Data Developer

Singapore

Big Data Developer
Experience: (3 – 10 Years)

Job Requirements:

• Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust

• Experience in designing application solutions in hadoop ecosystem

• Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark

• HDFS file formats and their use cases (eg Parquet, ORC, Sequence etc)

• Good knowledge in data warehousing system

• Experienced in any scripting language (SHELL, PYTHON)

• HortonWorks distribution and understanding on SQL engines (Tez, MR)

• Java/RestServices/Maven experience is a value addition

• Control-M development. Monitoring Resource utilization using Grafana Tool

• Good skillset to create automation scripts in Jenkins & knowledge in working on automating builds, test frameworks, app configuration etc

• Experience in implementing scalable applications with fully automated deployment and control using Bitbucket, Jenkins, ADO etc

  Skillset:

  o Mandatory: Big Data – Hive, HDFS, Spark, Scala, Pyspark.

  o Good to have : Schedulers (Control-M), ETL Tool – Dataiku , Unix/Shell scripting , Knowledge of Integration services of FileIT/MQ and others , CI/CD tools – Jenkins, Jira, ADO Devops – tools suite , Oracle .

When you apply, you voluntarily consent to the disclosure, collection and use of your personal data for employment/recruitment and related purposes in accordance with the Tech Aalto Privacy Policy, a copy of which is published at Tech Aalto’s website (https://www.techaalto.com/privacy/)

Confidentiality is assured, and only shortlisted candidates will be notified for interviews.