Data Engineer

About the Role

We are seeking a highly skilled Data Engineer to support large‑scale data migration and ongoing data platform development within our AWS cloud environment. This role requires deep expertise in relational databases, Amazon Redshift, PostgreSQL, Python, SQL, and secure access management for large user groups. You will work across manual data operations, automated pipelines, and deployment processes to ensure reliable, scalable, and secure data delivery.

Key Responsibilities

• Lead end‑to‑end data migration initiatives across relational databases, Redshift, and PostgreSQL.
• Design and implement ETL/ELT pipelines for structured and semi‑structured data.
• Optimise schemas, queries, and data models for performance and scalability.
• Validate, reconcile, and troubleshoot data quality issues during and after migration.
• Build and maintain data solutions using AWS services such as S3, Redshift, RDS/Postgres, IAM, Lambda, Glue, EC2.
• Ensure secure and efficient data storage, access patterns, and cross‑service integrations.
• Support environment setup, configuration, and cloud deployments.
• Manage IAM roles, policies, permission boundaries, and database‑level access for large user groups.
• Implement governance, auditing, and compliance controls across AWS and database environments.
• Maintain secure, scalable access models for analysts, engineers, and business users.
• Write high‑quality Python and SQL for data processing, validation, and automation.
• Automate manual workflows, data operations, and deployment processes using scripts or orchestration tools.Support CI/CD pipelines and version‑controlled deployment practices.
• Build reusable frameworks for ingestion, quality checks, and monitoring.
• Support production systems, troubleshoot incidents, and optimise performance.
• Maintain documentation, runbooks, and operational standards.
• Collaborate with cross‑functional teams including analysts, product teams, and engineering groups.

Skills & Experience

Essential

• Strong experience as a Data Engineer working in AWS cloud environments.
• Advanced proficiency in Python and SQL.
• Hands‑on experience with Redshift, PostgreSQL, and relational database migration.
• Experience managing IAM and multi‑user access models.
• Experience with deployments, environment management, and CI/CD workflows.
• Ability to work with both manual data processes and automated pipelines.
• Strong understanding of ETL/ELT concepts, data modelling, and performance tuning.

Desirable

• Experience with AWS Glue, Step Functions, Airflow, or similar orchestration tools.
• Familiarity with Terraform or CloudFormation.
• Knowledge of data governance, metadata management, and lineage tools.

To be eligible to apply, you must be an Australian / New Zealand citizen or hold permanent residency status in Australia. Please only apply if you meet the above skills