Cloud Data Engineer

About the Role

The Cloud Data Engineer is responsible for preparing enterprise-grade data products and driving technical thought leadership to support advanced analytics initiatives. This position entails designing, developing, and maintaining scalable data solutions on Microsoft Azure, ensuring the delivery of clean, reliable, and fit-for-purpose data for consumption across the organisation. Key responsibilities include building robust data pipelines, integrating APIs, and leveraging Azure services to enable advanced analytics and business intelligence capabilities.

Key Responsibilities

• Design, build, and maintain scalable, efficient data pipelines on Microsoft Azure (Azure Data Factory, Synapse Analytics, Databricks)
• Develop and optimise ETL/ELT processes to ingest data from diverse sources, including APIs, databases, and flat files
• Ensure data quality, integrity, and governance across pipelines, applying validation and cleansing standards
• Collaborate with data analysts, BI developers, and business stakeholders to understand data requirements and translate them into technical solutions
• Build and maintain data models (e.g. star/snowflake schemas) to support reporting and analytics
• Integrate third-party and internal APIs to automate data flow between systems
• Monitor pipeline performance, troubleshoot failures, and implement improvements for reliability and scalability
• Apply security and compliance best practices to data solutions, including access controls and data protection standards (e.g. POPIA)
• Document technical designs, data flows, and standard operating procedures
• Provide technical guidance and contribute to best-practice standards across the data engineering function

Required Qualifications & Experience

• National Diploma or Bachelor's degree in Computer Science, Information Systems
• 3+ years' experience in a data engineering or cloud engineering role
• Demonstrated experience building and maintaining data pipelines in a production environment
• Experience working within a Microsoft Azure ecosystem (Azure Gold Partner environment advantageous)

Technical Skills

• Azure services: Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, Azure Data Lake Storage
• Programming/Query languages: SQL, Python (PySpark advantageous)
• Data modelling: Dimensional modelling, data warehousing concepts
• API integration: REST APIs, authentication protocols (OAuth2), JSON/XML data handling
• DevOps/Version control: Git, CI/CD pipelines (Azure DevOps advantageous)
• BI tools: Power BI or similar reporting/visualisation tools (advantageous)

Soft Skills & Attributes

• Strong analytical and problem-solving mindset
• Ability to communicate technical concepts clearly to non-technical stakeholders
• Self-starter with the ability to work independently and manage multiple priorities
• Collaborative team player who thrives in a fast-paced, evolving environment
• Commitment to continuous learning and staying current with cloud/data technologies

Nice to Have

• Microsoft Azure certifications (e.g. DP-203: Data Engineering on Microsoft Azure)
• Experience with Microsoft Fabric
• Exposure to machine learning/advanced analytics workflows

Work Location: Hybrid remote in Johannesburg, Gauteng