Big Data Engineer - Data Platform, Global E-Commerce

Responsibilities

The mission of the Data Platform Singapore Business Partnering (DPSG BP) team is to empower the business with data. Our goal is to build a Data Warehouse that can cater to batch and streaming data, Data Products that provide useful information to build efficient data metrics & dashboards which will be used to make smarter business decisions to support business growth. If you're looking for a challenging ground to push your limits, this is the team for you! Responsibilities

• Translate business requirements & end to end designs into technical implementations and responsible for building batch and real-time data warehouse.
• Manage data modeling design, writing, and optimizing ETL jobs.
• Collaborate with the business team to build data metrics based on data warehouse.
• Responsible for building and maintaining data products.
• Involvement in rollouts, upgrades, implementation, and release of data system changes as required for streamlining of internal practices.
• Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software.
• Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets.
• Visualise, interpret, and report data findings and may create dynamic data reports as well.

Qualifications

Minimum Qualification(s):

• At least 3 years of experience in software engineering and 2 years of relevant experience in data engineering.
• Proficient in creating and maintaining complex ETL pipelines end-to-end while maintaining high reliability and security.
• Familiar with data warehouse concepts and have production experience in modeling design.
• Familiar with at least 1 distributed computing engine (e.g. Hive, Spark, Flink).

Preferred Qualification(s):

• Familiar with at least 1 NoSQL database is a plus (e.g. HBase).
• Excellent interpersonal and communication skills with the ability to engage and manage internal and external stakeholders across all levels of seniority.
• Strong collaboration skills with the ability to build rapport across teams and stakeholders.