Senior Data Engineer

Lead the evolution of our Azure Databricks platform and help shape the future of data engineering at Skills Group.

Skills Group is looking for an experienced Senior Data Engineer - Azure Databricks to lead the continued design, build, and delivery of our data platform. With the core foundations already in place, you'll take ownership of extending, hardening, and scaling the platform - introducing new capability, strengthening governance, and improving engineering practices as our data environment matures.

This is a senior, hands-on technical leadership role where you'll lead and grow a small team of data engineers, set technical direction and engineering standards, and partner closely with analytics, BI, and business stakeholders. Proven production experience with Azure Databricks is essential for this role.

Based at our Ellerslie office, you'll enjoy a hybrid working model with three days in the office and two days working from home each week.

What you'll be doing:

• Lead the continued development and evolution of our Azure Databricks lakehouse architecture, including Delta Lake and Unity Catalog.

• Design and build scalable ETL/ELT pipelines using SQL and Python, and extend capability across the Azure data ecosystem.

• Mature CI/CD, infrastructure-as-code, DevOps, monitoring, and observability practices.

• Strengthen data governance, quality, access control, security, performance, and reliability.

• Lead, coach, and mentor data engineers while setting technical direction and engineering standards.

• Partner with analytics, BI, and business stakeholders to deliver trusted data solutions and contribute to the broader data strategy.

What you'll bring:

• Proven experience delivering and supporting production data platforms on Azure Databricks, including Delta Lake and Unity Catalog - this is essential.

• Strong Azure data ecosystem experience, including Azure Data Factory, Azure Data Lake Storage Gen2, and Azure Key Vault.

• Strong SQL and Python skills, with experience in data modelling and building scalable data pipelines.

• Experience with CI/CD, infrastructure-as-code, data governance, data quality, and access control.

• Experience leading or mentoring data engineers, setting technical direction, and working within agile delivery environments.

• Strong stakeholder management and communication skills, plus a relevant Bachelor's degree or equivalent industry experience.

• Nice to have: Power BI experience, streaming or near-real-time data ingestion experience, and relevant Databricks or Microsoft Azure certifications.

Why join Skills Group?

At Skills Group, our purpose is to maximise human potential. For more than 30 years, we've partnered with learners, employers and industry to build a skilled workforce across New Zealand. You'll join a collaborative environment where you'll have the opportunity to influence technical direction, develop your team, and play a key role in the continued evolution of our data capability.

Benefits that back you:

• Health & wellbeing: Fully subsidised Southern Cross medical insurance, TELUS Health Employee Assistance Programme (EAP), and annual flu vaccinations.

• Flexible work & leave: Hybrid working with three days in the office and two days from home, birthday leave, long service leave, and enhanced bereavement leave.

• Financial benefits: 3.5% KiwiSaver contribution, 2% SuperLife contribution, and a $500 employee referral bonus.

• Learning & development: Two paid learning hours each week, LinkedIn Learning access, Future Fit development opportunities, and ongoing professional growth support.

If you're an experienced Azure Databricks engineer ready to take technical ownership, lead others, and help mature a growing data platform, we'd love to hear from you.

Apply today and help shape the future of data at Skills Group.