Senior Data Engineer

Birmingham, Cardiff, Edinburgh, Exeter, Ipswich, Leeds, Manchester, Newcastle and Nottingham. (Croydon and Stratford will only be available to existing employees of the Insolvency Service).

Job Summary About Us We help the UK move forward, faster.

For nearly 150 years, we've protected the UK economy with deep expertise and rigour, building the confidence that helps businesses access lending, investment and opportunity.

We help people deal with personal insolvency. We make statutory redundancy payments when insolvent employers can't. We investigate director conduct and take action where it's needed.

And right now, we're changing how we do all of this, becoming faster, more digitally driven, and more focused on stopping problems before they escalate.

More than 2,000 of us work in offices across England, Scotland and Wales. It might be time for you to join us.

The Role We're looking for a Senior Data Engineer who wants more than a job that ticks boxes.

As a Senior Data Engineer, you will lead the development and governance of our enterprise architecture, helping the Insolvency Service align its technology with organisational strategy, digital transformation and secure-by-design principles. Your work will support long-term capability, operational resilience and value for money.

This supports creating a modern, sustainable Insolvency Service by aligning technology decisions with our long-term organisational needs.

This is a role for someone who wants to think bigger, challenge the way things have always been done, and take ownership of the outcomes that matter.

We offer full-time, part-time, job share, and flexible working. We invest in your development and give our people the space to grow, take ownership and make decisions.

Job Description Reporting to the Head of Data & Technology, you will join the team, helping turn organisational data into trusted information.

You will work across Microsoft Fabric, OneLake and other organisational systems to develop secure, appropriately governed data solutions. This will include integrating information from sources such as Dynamics 365, Dataverse and Azure services to support analytics, reporting and AI.

Working with technical teams, third-party suppliers, data scientists and analysts, you will translate data requirements into robust engineering solutions. You will also provide technical leadership, support other engineers and act as an escalation point for complex data engineering and pipeline issues.

Responsibilities You'll use your judgement and expertise to:

• design, develop and maintain complex data ingestion, transformation and integration pipelines using Microsoft Fabric, OneLake and organisational data sources
• develop reusable engineering components, trusted datasets and data products to support analytics, reporting, Azure AI and machine-learning workloads
• implement validation, reconciliation and quality controls, ensuring that data solutions meet agreed lineage, metadata, governance and security standards
• implement CI/CD, automated testing and DataOps practices, optimising pipelines for performance, scalability, resilience and cost
• monitor and troubleshoot data pipelines, lead root-cause analysis and work with development security operations (DevSecOps), artificial intelligence operations (AIOps) and Application Support to improve operational reliability
• work with data scientists, analysts, delivery teams and suppliers to translate requirements into robust solutions, supported by appropriate documentation and recovery procedures
• provide technical leadership and management support to other engineers through mentoring, peer review and technical assurance, contributing to engineering standards and continuous improvement.

Reporting to the Head of Data & Technology, you will join the team, helping turn organisational data into trusted information.

You will work across Microsoft Fabric, OneLake and other organisational systems to develop secure, appropriately governed data solutions. This will include integrating information from sources such as Dynamics 365, Dataverse and Azure services to support analytics, reporting and AI.

Working with technical teams, third-party suppliers, data scientists and analysts, you will translate data requirements into robust engineering solutions. You will also provide technical leadership, support other engineers and act as an escalation point for complex data engineering and pipeline issues.

You'll Use Your Judgement And Expertise To

• design, develop and maintain complex data ingestion, transformation and integration pipelines using Microsoft Fabric, OneLake and organisational data sources
• develop reusable engineering components, trusted datasets and data products to support analytics, reporting, Azure AI and machine-learning workloads
• implement validation, reconciliation and quality controls, ensuring that data solutions meet agreed lineage, metadata, governance and security standards
• implement CI/CD, automated testing and DataOps practices, optimising pipelines for performance, scalability, resilience and cost
• monitor and troubleshoot data pipelines, lead root-cause analysis and work with development security operations (DevSecOps), artificial intelligence operations (AIOps) and Application Support to improve operational reliability
• work with data scientists, analysts, delivery teams and suppliers to translate requirements into robust solutions, supported by appropriate documentation and recovery procedures
• provide technical leadership and management support to other engineers through mentoring, peer review and technical assurance, contributing to engineering standards and continuous improvement.

Person specification

We're Looking For Someone Who Can

• apply strong data engineering knowledge to complex technical problems
• diagnose underlying issues and develop effective, sustainable solutions
• maintain high standards of data quality, engineering quality and operational reliability
• build effective working relationships with technical teams, suppliers, analysts and service stakeholders
• identify opportunities to improve data pipelines, automation and platform performance.

Essential criteria

As The Successful Candidate You Will Have

• strong professional experience in data engineering
• advanced structured query language (SQL), data modelling and transformation skills
• experience with Microsoft Fabric, OneLake and/or Azure data services
• experience integrating transactional systems with analytical platforms
• a strong understanding of data quality, governance and lineage
• experience developing and operating complex data pipelines
• experience with continuous integration/continuous deployment (CI/CD), data operations (DataOps) and automated testing
• strong troubleshooting and root-cause analysis skills
• experience working across technical teams and third-party suppliers
• the ability to mentor and provide technical leadership to other engineers.

Further Information Please note: This vacancy is advertised across 11 locations; however, Stratford and Croydon are only available to current Insolvency Service Staff. The advertised salary includes London weighting, which is only applicable to internal candidates.

The successful candidates will be required to meet nationality and residency requirements so that National Security Vetting (NSV) checks can be conducted. If you want to learn more, visit United Kingdom Security Vetting: Applicant - GOV.UK (www.gov.uk)

Behaviours

We'll assess you against these behaviours during the selection process:

• Delivering at Pace
• Communicating and Influencing
• Making Effective Decisions

Alongside your salary of £48,429, Insolvency Service contributes £14,029 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides (opens in a new window).

Benefits We want you to have a good work-life balance and want to support you in all that you do, so we offer a great benefits package including:

• flexible working arrangements and flexi-time
• full time new entrants to the Civil Service and those Civil Servants on modernised terms and conditions will be entitled to 25 days leave increasing on a sliding scale to 30 days after 5 years’ service
• in addition to this you are entitled to 8 public/bank holidays plus an additional day of privilege leave
• competitive maternity, paternity and parental leave
• 5 days paid leave for learning and development
• 5 days paid for volunteering
• a Cycle to work scheme
• staff have access to an employee assistance programme, Workplace Wellness, for confidential, independent support and advice during difficult times in either their professional or personal life

Your pension is a valuable part of your total reward package where the employer makes a significant contribution to the cost of your pension. Your contributions come out of your salary before any tax is taken. This means, if you pay tax, your take-home pay will not be reduced by the full amount of your contribution; and your pension will continue to provide valuable benefits for you and your family if you are too ill to continue to work or die before you retire. For more information, visit www.civilservicepensionscheme.org.uk

Artificial intelligence

Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance (opens in a new window) for more information on appropriate and inappropriate use.

Selection process details

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Strengths and Experience.

Application and Sift As part of the application process, you will be asked to complete:

• CV
• Personal Statement

Should a large number of applications be received, an initial sift may be conducted using the CV, assessing candidates against the essential criteria. Only those who meet the essential criteria at this stage will proceed to a full assessment of their application. If a candidate does not meet the minimum requirements during the initial sift, the remainder of their application will not be reviewed. Candidates who pass the initial sift may be progressed to a full sift or progressed straight to interview.

Where high volumes of strong applications are expected or received, we may raise the ‘benchmark’ minimum score required at the sift stage. If a high volume of candidates meet the benchmark score, we may further raise the score required for interview selection. Scores will be applied fairly and consistently. Applicants eligible under a recruitment scheme may, where appropriate, continue to be considered against the agreed ‘benchmark’ score, to support the purpose of the scheme.

CV Guidance Your CV should provide a clear overview of your employment history, key responsibilities, relevant qualifications, and the skills and experience you’ve gained throughout your career including any notable achievements.

Note: Your CV will be scored as part of the assessment process and will be assessed against the criteria outlined in the job advert.

Personal Statement Guidance Your personal statement should be no more than 500 words and must demonstrate how your personal skills, qualities, and experience align with the requirements of the role. Please ensure your statement references the essential criteria outlined in the person specification.

Interview Stage If successful at the sift stage, at interview, you will be assessed on the following:

Experience Behaviours

• assessed through:

• Behaviour 1 - Delivering at Pace

• Behaviour 2 - Communicating and Influencing

• Behaviour 3 - Making Effective Decisions

Strengths Expected timeline (subject to change) Sift – w/c to be confirmed

Interview – w/c to be confirmed

Location - MS Teams

Your interview will be conducted by video. You will be notified of this if you are selected for interview. Candidates are asked to note the above timetable, exercising flexibility through the recruitment process.

Visa Applicants To sponsor a candidate under the Skilled Worker visa, a sponsorship licence is required. The Insolvency Service does not currently hold this licence and therefore, cannot legally sponsor Skilled Worker visa applicants.

Hybrid Working The Insolvency Service’s hybrid working policy offers flexibility over when and where you work and collaborate, subject to business needs.

You are expected to work from an office listed in this advert to connect with colleagues, as your role and team require. You can split your working week, but must spend at least 60% in the workplace, including offices, site visits, court and other work locations.

Further Information A reserve list may be held for a period of 12 months from which further appointments can be made.

If successful and transferring from another Government Department a criminal record check may be carried out.

In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service and Disclosure Scotland on your behalf.

However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing [email protected] stating the job reference number in the subject heading.

For further information on the Disclosure Scotland confidential checking service telephone: the Disclosure Scotland Helpline on 0870 609 6006 and ask to speak to the operations manager in confidence, or email [email protected]

New entrants are expected to join on the minimum of the pay band.

Reasonable Adjustment We must make reasonable adjustments if our recruitment process puts a disabled applicant at a substantial disadvantage. These are changes or support that help remove or reduce that disadvantage.

If you need an adjustment to apply, contact Government Recruitment Service at [email protected] as soon as possible before the closing date.

For adjustments later in the recruitment process, complete ‘Assistance required’ on the ‘Additional requirements’ page of your application form. Examples include wheelchair access at interview or communication support if you are deaf or hard of hearing.

If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section.

For further information on National Security Vetting please visit the Demystifying Vetting website.

Queries and Support When contacting us or the Government Recruitment Service (GRS) using the contact details at the bottom of this advert, please include the 6-digit Vacancy ID, job title, your full name and, where applicable, your 8-digit Applicant ID in the email subject line. This will help us process your enquiry more efficiently.

Feedback Feedback will only be provided if you attend an interview or assessment.

This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Strengths and Experience.

Security

Successful candidates must undergo a basic (or equivalent) criminal record check.

Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).See our vetting charter (opens in a new window).

People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Successful candidates must undergo a basic (or equivalent) criminal record check.

Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window).See our vetting charter (opens in a new window).

People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This Job Is Broadly Open To The Following Groups

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements (opens in a new window)

Working for the Civil Service

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window).

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window).

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).

This vacancy is part of the Great Place to Work for Veterans (opens in a new window) initiative.

The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment (opens in new window).

Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants

Job Contact

• Name : Andrew Muncaster
• Email : [email protected]

Recruitment team

• Email : [email protected]

Further information

You can complain to the Insolvency Service if you believe you have experienced discrimination under the Equality Act 2010, procedural errors at any recruitment stage, or a breach of the Recruitment Principles (appointment on merit through fair and open competition).

First, email Government Recruitment Service at [email protected]. Your complaint must reach the contact point for applicants within 24 hours of being told you were unsuccessful at sift, assessment or interview.

An independent third party outside the recruitment campaign will consider your complaint. You will receive a written decision within 5 working days of receipt. Recruitment will usually be paused until your complaint is resolved.

If you are dissatisfied with the response, you can contact the Civil Service Commission about a suspected breach of the Recruitment Principles. You can complain to the Commission at any time, but must first raise your complaint with Government Recruitment Service.