Data Engineer

Principal Duties and Responsibilities:

Contribute to the development of the enterprise data lake/lakehouse using moderntechnologies (Databricks, Snowflake). Build and maintain data integration pipelines for batch and streaming data between internalsystems, external partners and cloud services. Implement ETL/ELT and reverse ETL processes to support analytics, reporting and AI/MLworkloads. Develop, optimize, and maintain scalable data pipelines for structured, semi-structured, andunstructured data. Monitor, troubleshoot, support and resolve any issues with data pipelines and data availability. Automate ingestion, transformation, and distribution workflows using orchestration tools. Create and maintain metadata catalogs, data lineage and feature stores. Collaborate closely with cross-functional teams and business stakeholders to understand datarequirements and deliver efficient technical solutions. Evaluate and adopt new tools and technologies to improve platform performance, costmanagement and engineering practices.New Job Opportunity Follow best-in-class development, testing, and documentation standards, especially also usingCI/CD pipelines. Apply and maintain data quality rules ensuring accuracy, completeness, and consistency acrosspipelines. Ensure adherence to security, compliance, and data protection standards.

Critical Competencies/Minimum Requirements:

Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent technical field. 3+ years of hands-on experience in data engineering or a similar role.

Strong experience with:

o Data processing frameworks: Apache Spark, Snowflake, Databricks

o Data storage technologies: Lakehouse/Delta Lake, data lakes

o Programming languages: Python, SQL Solid understanding of data modeling, ETL/ELT, and data warehousing principles. Experience with orchestration tools (e.g., Airflow, Prefect). Familiarity with cloud platforms (preferably Azure).

Experience with metadata management tools. Strong analytical and problem-solving skills. Ability to work collaboratively in a cross-functional environment. Good communication and documentation skills.

Job Type: Full-time

Pay: RM11,000.00 - RM15,000.00 per month

Benefits:

• Health insurance
• Opportunities for promotion
• Professional development

Work Location: In person