Lead Data Pipeline Engineer

• 12 + 12 month contract – Lead EL2 level
• NV1 Security Clearance - Brisbane CBD offices
• Flexible work arrangements - 7.5 hour day
• Cloud-based architecture for data storage and pipelines

Our client, an independent Federal statutory agency based in Brisbane CBD, QLD, requires the services of a Lead Data Pipeline Engineer for a 12 +12 month contract.

Duties of the Lead Data Pipeline Engineer:

• Design: Creating scalable data pipelines that meet project requirements.
• Maintain: Optimising pipelines for performance and scalability.
• Monitor: Troubleshooting issues and documenting processes.
• Collaborate: Working with analysts and data scientists to understand data needs.
• Automate: Writing scripts to automate repetitive tasks.

Skills and Experience - Lead Data Pipeline Engineer:

Essential criteria

• Minimum of five years’ experience working as a Data Pipeline Engineer in a Cloud Computing environment.
• Demonstrated experience configuring (design, build, test, deploy) varying types of data pipelines solutions e.g. MFT, API, File extracts etc.
• Good command of AWS as it relates to Data Storage, Extraction, Transformation, Data processing frameworks, and security concepts around these.
• Experience with Agile development methodologies (Scrum, Kanban, Lean, Xtreme Programming).

Desirable criteria

• Minimum of 4 years in a similar role.
• Experience with GoAnywhere MFT. Experience with Ctrl-M orchestration
• Experience with CI/CD automation / GITHub / Bitbucket

How to Apply

For a copy of the full job description, including the application instructions, please get in touch with Andy at Recruitment Hive by clicking the Quick Apply button. Alternatively, you can reach Andy on (02) 6299 1006 6299 1006) to discuss further.

Please note that applications close at 11am on the 16th of Sep 2026. Recruitment Hive welcome late applications to be considered for future opportunities.

We Value Diversity

The Recruitment Hive is a proud Equal Opportunity Employer. We recognise the value of diverse perspectives and experience and are committed to an inclusive workplace where everyone feels valued and respected for who they are. We encourage people with disability, indigenous, veterans and people of all backgrounds and abilities to express their interest in this role.

Job ID: AE 678281 | LH-07695