Data Engineer

JOB PURPOSE

To develop and implement needed solutions and adhere to planned projects to enrich the Big data & Data warehouse layers with required data across the organization and ensure proper storage of data assets; also ensure the proper delivery of required data elements for either reporting or application needs.

KEY ACCOUNTABILITIES:

Data Modelling

• Assist the DWH & Big Data teams to develop & deliver the proposed Data Architecture
• Support in creating logical & physical data model for the required data structures using client's modelling standards and standard ERWin modelling tools.
• Execute the process of data mapping between source systems and EDW and from EDW to different integrated systems.

Data Transformation(ETL)

• Implement different data integration & ETL workflows and jobs between data sources and Enterprise Data Warehouse (EDW) and from EDW to different integrated systems

Data Consumption

• Develop different application data needs from EDW
• Implement the best approaches to use for applications data integration with EDW

Data Development

• Put Hadoop and big data technology stack in work and development of the needed data applications for better data development.
• Implement data integration and distribution across Hadoop nodes
• Apply best data movements techniques from and to Hadoop.
• Controls adhere to the guiding principles of data warehousing & Big Data.
• Develop a feedback loop with data science and EPM/ERM team to constantly enhance data structure.

Day-to-day operations

• Follow the day-to-day operations related to own jobs in the department to ensure continuity of work

Policies, Processes and Procedures

• Follow all relevant department policies, processes, standard operating procedures and instructions so that work is carried out in a controlled and consistent manner.

Compliance

• Comply with all relevant CBE regulations, banking laws, AML regulations and internal CIB policies and code of conduct in order to maintain CIB s sound legal position and mitigate any potential risks

Day-to-day operations

• Follow the day-to-day operations related to own jobs in the department to ensure continuity of work.

Policies, Processes and Procedures

• Follow all relevant department policies, processes, standard operating procedures and instructions so that work is carried out in a controlled and consistent manner.

Desired Candidate Profile

• Excellent analytical skills
• Excellent interpersonal and communication skills;
• Demonstrated ability to effectively work in a dynamic & cross-team environment and work independently and directly with the business partners.

Qualifications & Experience

• Bachelor s degree of computer science or its equivalent.
• 3+ years experience with enterprise data warehouse & Big Data management; with experience in data architecture
• Sound understanding of the financial services industry that allows for a detailed interpretation of budgetary, financial, and related management information
• Experience in handling complex, high-volume, high-dimensionality data from varying sources
• Excellent Data management skills using SQL, ErWin, and other Data Management tools
• Excellent ETL skills with knowledge of Informatica & Data Stage
• Excellent Hadoop development skills (HBase, Hive, Impala, MR, .)
• Strong programming and object oriented experience (Java, Python, C#,..).