Data Engineer

On behalf of the Department for Business and Trade we are looking for a Data Engineer (Inside IR35) for an initial 6 month contract. Hybrid working with 2 days per week based in London, Cardiff, Edinburgh, Belfast, Manchester, Birmingham or Darlington.

SC Clearance is an essential requirement for this role, as a minimum you must be willing & eligible to undergo checks. Please note, due to the exceptional requirements of this position (short-term nature of this role and speed at which we require a postholder in situ) preference may be given to candidates who meet all of the essential criteria and hold active security clearance.

As a Data Engineer your main responsibilities will be to:

* Assess and define requirements for data engineering activities across the MoG programme.

* Design and develop scalable ETL/ELT data pipelines.

* Support the implementation and enhancement of data platform components.

* Deliver and maintain data integrations and APIs.

* Build and optimise AI data feeds and training data pipelines.

* Improve and maintain data quality, validation, and trust frameworks.

* Develop automation scripts to support engineering and operational processes.

* Create monitoring solutions and operational dashboards.

* Implement data security, governance, and compliance controls.

* Produce high-quality technical documentation and reusable engineering assets.

* Contribute to discovery activities, technical assessments and effort estimation.

Essential Skills & Experience

* Demonstratable experience of working as a Data Engineer.

* Experience in AWS and Terraform for Infrastructure as Code (IaC).

* SQL, Python and Airflow 3 experience.

* Candidates should be capable of working independently in cloud-based data environments and possess excellent communication skills, with the ability to engage effectively with both technical and non-technical stakeholders.

Please be aware that this role can only be worked within the UK and not Overseas.

In applying for this role, you acknowledge the following "this role falls in scope of the Off Payroll Working in the Public Sector legislation. Any rates of payment quoted will reflect the gross rate per day for the assignment and will be subject to appropriate taxes and statutory costs. As such the payment to the intermediary and your income resulting from this contract will be different".