Senior Data Engineer – Databricks & SAP Migration

Senior Data Engineer – Databricks & SAP Migration | Contract | 6 Months | Cape Town

About the Role

A large South African retailer is migrating from an on-premises data estate to Databricks, building a governed modern data platform using Medallion Architecture and Data Vault modelling. They need a Senior Data Engineer who can drive this migration technically, engage stakeholders up to C-suite level, and bring Finance and Economics data domain knowledge to ensure complex business rules translate correctly into the new platform.

Due to the high volume of applications expected, candidates who have not received feedback within

two weeks of applying should consider their application unsuccessful.

Key Responsibilities

• Support and drive the migration from on-premises data infrastructure to Databricks
• Design and build data solutions using Medallion Architecture and Data Vault modelling principles
• Develop and maintain data pipelines using Databricks, PySpark, Python, and SQL
• Apply SAP data exposure to support finance and economics data workstreams through the migration
• Translate complex business and finance rules into robust, governed data engineering solutions
• Engage business and technical stakeholders, including C-suite, on migration progress and outcomes
• Ensure the emerging data platform meets governance, quality, and security standards

Requirements

• Senior-level Databricks experience, including PySpark and Python
• Strong SQL skills and experience with Data Vault modelling and Medallion Architecture
• SAP exposure, particularly within Finance or Economics data domains
• Experience managing data migrations from on-premises environments to cloud or lakehouse platforms
• Ability to communicate technical progress and risks clearly to C-suite stakeholders
• Finance or Economics data domain experience highly advantageous

Role Details

• Duration: 6 months
• Start date: Immediate
• Location: Cape Town, hybrid (3 days on-site per week)