Data Engineer (AWS/ Amazon Cloud)

About the role

We are seeking an AWS Data Engineer to join in a full-time position based in the Central Region. This is a strategic role that sits at the heart of our data infrastructure, where you will be responsible for designing, building, and maintaining robust data solutions on Amazon Web Services (AWS). You will play a crucial role in enabling the organisation to harness the power of data, supporting business intelligence, analytics, and operational efficiency across the company. This position offers an excellent opportunity to work with cutting-edge cloud technologies whilst contributing directly to our digital transformation initiatives.

Key Responsibilities

·       Design, develop, and maintain scalable data pipelines using PySpark on AWS.

·       Build and orchestrate ETL/ELT workflows using AWS Glue and AWS Step Functions.

·       Develop serverless applications and automation using AWS Lambda.

·       Write clean, efficient, and maintainable Python/PySpark code following engineering best practices.

·       Provision and manage cloud infrastructure using Terraform (Infrastructure as Code).

·       Implement and maintain CI/CD pipelines to automate code deployment, testing, and infrastructure changes.

·       Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and cost efficiency.

·       Collaborate with business stakeholders to deliver data solutions.

·       Follow DevOps, security, and coding standards throughout the engagement.

Required Skills

·       Strong hands-on experience with PySpark and Python for data engineering.

·       Experience developing ETL pipelines using AWS Glue.

·       Proficiency with AWS Step Functions for workflow orchestration.

·       Experience building serverless solutions using AWS Lambda.

·       Hands-on experience with Terraform for Infrastructure as Code (IaC).

·       Experience implementing CI/CD pipelines using tools such as GitLab, GitHub Actions, Jenkins, or similar.

·       Good understanding of AWS services, data lakes, IAM, S3, CloudWatch, and monitoring.

Apply now

To express your interest in this exciting opportunity, please submit your CV, covering letter, and any relevant certifications to our recruitment team. We look forward to hearing from you.