Data Engineer (Onsite)

Job overview

Design and implement the methods for storing and retrieving the data and monitoring the data pipelines, starting from the ingestion of raw data sources, transforming, cleaning and storing, enrich the data for promptly using for both of structured and unstructured data, and working with the data lake and cloud which is the big data technology.

Responsibilities
- Develop data pipeline automation using Azure technologies, Databricks and Data Factory

• Understand data, reports and dashboards requirements, develop data visualization using Power BI, Tableau by working across workstreams to support data requirements including reports and dashboards and collaborate with data scientists, data analyst, data governance team or business stakeholders on several projects
• Analyze and perform data profiling to understand data patterns following Data Quality and Data Management processes

Qualifications

• 3 years+’ experience in big data technology, data engineering, data analytic application system development.
• Have an experience of unstructured data for business Intelligence or computer science would be advantage.
• Technical skill in SQL, UNIX and Shell Script, Python, R Programming, Spark, Hadoop programming.