Data Engineer

Data Engineer

Cape Town | Hybrid / Remote Opportunities Available

Permanent

About the Opportunity

Our client is continually seeking talented Data Engineers to join high-performing technology teams delivering modern data solutions across a range of industries. This is an opportunity to work on cutting-edge cloud platforms, large-scale data ecosystems, and enterprise data transformation initiatives.

As a Data Engineer, you will be responsible for designing, building, and optimising scalable data pipelines and platforms that enable advanced analytics, reporting, machine learning, and business intelligence capabilities.

Key Responsibilities:

• Design, develop, and maintain robust data pipelines and ETL/ELT processes.
• Build and optimise scalable data platforms capable of handling large volumes of structured and unstructured data.
• Integrate data from multiple internal and external sources.
• Develop and maintain data models, data warehouses, and data lakes.
• Ensure data quality, integrity, security, and governance across the data ecosystem.
• Collaborate with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions.
• Automate data ingestion, transformation, and orchestration processes.
• Monitor, troubleshoot, and improve data platform performance and reliability.
• Contribute to cloud migration and modernisation initiatives.
• Support the implementation of best practices around DataOps, CI/CD, and data engineering standards.

Required Skills & Experience:

• 5+ years' experience in Data Engineering or a related field.
• Strong SQL development skills.
• Proficiency in Python, Scala, or similar programming languages.
• Experience building ETL/ELT pipelines.
• Experience working with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.
• Strong understanding of data warehousing and dimensional modelling principles.
• Experience working with large datasets in enterprise environments.
• Knowledge of source control and DevOps practices.

Preferred Technologies

Experience with some or all of the following:

• Azure Data Factory
• Azure Synapse Analytics
• Databricks
• Microsoft Fabric
• Snowflake
• Apache Spark
• Kafka
• Airflow
• SQL Server
• Azure DevOps
• Git
• Power BI

What We're Looking For:

• Strong problem-solving and analytical thinking skills.
• Passion for modern data platforms and emerging technologies.
• Excellent communication and stakeholder engagement abilities.
• Ability to work in agile, collaborative development environments.
• A proactive mindset with a focus on continuous improvement.
• Strong attention to detail and commitment to delivering quality solutions.

Nice-to-Have Experience:

• Real-time and streaming data solutions.
• Data lakehouse architectures.
• CI/CD implementation for data platforms.
• Machine learning data pipelines.
• Financial services, retail, telecommunications, or enterprise consulting environments.

Why Apply?

• Work on enterprise-scale data projects.
• Exposure to modern cloud and data technologies.
• Collaborate with highly skilled engineering teams.
• Opportunities for professional development and certification.
• Flexible and dynamic working environment.