Data & Platform Engineer

Context

A technology organisation is expanding its Advanced Analytics capabilities and is building the next generation of its Data Science and AI platform.

The company is looking for a Data & Platform Engineer to design and maintain the data infrastructure enabling analytics, machine learning, and AI initiatives across the organisation.

This role focuses on building scalable data pipelines, supporting data teams, and contributing to the evolution of a modern cloud-based data platform.

Responsibilities

• Develop and maintain the Data Science & AI platform

• Enable experimentation, deployment, and monitoring of machine learning workloads

• Implement MLOps best practices and CI/CD for data products

• Design and build reliable data ingestion pipelines

• Optimize data transformation processes and data models

• Ensure data quality, reliability, and security

• Collaborate with Data Scientists to industrialize features and datasets

• Support analytics and advanced AI use cases

• Ensure platform usability, documentation, and continuous improvement

• Work closely with Data Scientists, Analysts, and Architects to build reusable data assets

Technical skills

Must have

• Minimum 3 years of experience in Data Engineering or Platform Engineering

• Strong experience with cloud services for industrialized data analytics projects

• Proven expertise with Databricks (core runtime, jobs, workflows, Delta Lake)

• Experience with Infrastructure-as-Code (Terraform preferred)

• Strong Python and PySpark skills

• Experience with SQL

• Knowledge of Git and CI/CD workflows

• Fluent in English

• Ability to work onsite two days per week (Tuesday and Thursday)

Should have

• Experience in building AI or Data Science platforms

• Good communication and collaboration skills

• Knowledge of containerisation principles

• Experience with Docker or Kubernetes

Nice to have

• Experience with Azure cloud platform