Senior Data Engineer (Banking)

Role Description

The Data Engineer is responsible for architecting, implementing, and maintaining robust data pipelines that support various AI and ML initiatives within the bank.

Responsibilities

• Collaborate with internal and external stakeholders to identify and acquire relevant data sources for AI/ML projects, leveraging on both structured and unstructured data to enrich the organization’s data assets.

• Develop and implement strategies for ingesting, cleansing and transforming data into designated data repositories, ensuring data quality, consistency and integrity throughout the process.

• Design and develop reusable and scalable data assets, including data models, pipelines, and workflows, that support the organization’s AI ML initiatives.

• Provide support and guidance to data analysts and data scientists in accessing, understanding and utilizing the data assets effectively for analytics and modelling purposes, optimizing the execution of AI ML algorithm and workflow.

• Optimize data processing and storage solutions to improve performance and reduce latency for AI and ML applications.

• Monitor and troubleshoot data pipelines, identifying and resolving issues to ensure uninterrupted data flow.

Job Requirements

• Bachelor’s degree in computer science, data science, engineering or related field.

• Proven experience in data acquisition, ingestion and management, preferably in a data engineering role.

• Strong understanding of data modelling, data warehousing and data integration concepts and best practices.

• Proficiency in Data modeling and schema design. Required tools: Apache Hadoop, Apache Spark, Apache Kafka, AWS/GCP/Azure services, SQL and NoSQL databases, Python/Java/Scala, Git version control, ETL (Extract, Transform, Load) processes and tools.

Pay: RM12,000.00 - RM15,000.00 per month

Work Location: In person