Data Engineer

Role/Purpose:

The Data Engineer will design, build and maintain Company central data platform supporting analytics, data distribution and AI/ML initiatives. This role involves developing scalable data pipelines, ensuring high-quality and secure data flows, and contributing to the foundation that powers advanced analytics and business insights across the organization.

The person on this position will work closely with data scientists, analysts, and business stakeholders to design, build, deliver and support trusted, well‑structured and secure high quality data for operational, analytical and AI/ML use case

Principal Duties and Responsibilities:

• Contribute to the development of the enterprise data lake/lakehouse using modern technologies (Databricks, Snowflake).
• Build and maintain data integration pipelines for batch and streaming data between internal systems, external partners and cloud services.
• Implement ETL/ELT and reverse ETL processes to support analytics, reporting and AI/ML workloads.
• Develop, optimize, and maintain scalable data pipelines for structured, semi-structured, and unstructured data.
• Monitor, troubleshoot, support and resolve any issues with data pipelines and data availability.
• Automate ingestion, transformation, and distribution workflows using orchestration tools.
• Create and maintain metadata catalogs, data lineage and feature stores.
• Collaborate closely with cross-functional teams and business stakeholders to understand data requirements and deliver efficient technical solutions.
• Evaluate and adopt new tools and technologies to improve platform performance, cost management and engineering practices.
• Follow best-in-class development, testing, and documentation standards, especially also using CI/CD pipelines. New Job Opportunity
• Apply and maintain data quality rules ensuring accuracy, completeness, and consistency across pipelines.
• Ensure adherence to security, compliance, and data protection standards.

Requirements:

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent technical field.
• 3+ years of hands-on experience in data engineering or a similar role.
• Strong experience with: o Data processing frameworks: Apache Spark, Snowflake, Databricks o Data storage technologies: Lakehouse/Delta Lake, data lakes o Programming languages: Python, SQL
• Solid understanding of data modeling, ETL/ELT, and data warehousing principles.
• Experience with orchestration tools (e.g., Airflow, Prefect).
• Familiarity with cloud platforms (preferably Azure).
• Experience with metadata management tools. Strong analytical and problem-solving skills.
• Ability to work collaboratively in a cross-functional environment.
• Good communication and documentation skills.
• Commitment to high-quality work, data security, and continuous improvement.

Pay: RM5,000.00 - RM15,000.00 per month

Benefits:

• Health insurance

Education:

• Bachelor's (Preferred)

Experience:

• data engineering: 4 years (Preferred)
• ETL: 3 years (Preferred)
• data lake/lakehouse: 3 years (Preferred)
• Databricks: 3 years (Preferred)

Work Location: In person