Data Engineers (SC Cleared) x2

Data Engineers (SC Cleared) x2

📍 Fully Remote (UK Based Only)

💷 Up to £340 per day (Inside IR35)

📅 Initial 3-Month Contract

🔒 Active SC Clearance Required

RedRock Consulting is partnering with a leading consultancy delivering a major UK Government data programme and is looking to engage 2x Data Engineers to support the build and delivery of large-scale cloud data solutions.

This is an opportunity to join a highly skilled team working on complex data integration and lakehouse initiatives, leveraging modern AWS technologies and best-practice engineering patterns.

The Role

You will be responsible for developing robust data ingestion and transformation solutions, creating reusable engineering templates, and supporting the delivery of complex data pipelines across multiple high-volume data sources.

Working closely with Lead Data Engineers, you'll contribute to solution design, performance optimisation, and the implementation of scalable data engineering patterns within a secure government environment.

Key Responsibilities

✅ Build and maintain data source connectivity and transformation templates

✅ Design and develop complex data pipelines for large and enterprise-scale data feeds

✅ Implement CDC (Change Data Capture) and incremental loading solutions

✅ Develop reusable engineering patterns and frameworks

✅ Support pipeline performance tuning and optimisation

✅ Collaborate with Lead Data Engineers to ensure correctness, scalability, and reusability of solutions

✅ Contribute to engineering standards, documentation, and best practices

Essential Skills & Experience

• Strong Data Engineering background
• Experience building data ingestion and transformation pipelines
• CDC (Change Data Capture) implementation experience
• Data pipeline scheduling and orchestration
• AWS Lakehouse architecture experience
• Strong Python and PySpark development skills
• Experience developing reusable templates and engineering patterns
• Agile delivery experience

Technical Stack

🔹 AWS Glue

🔹 Amazon S3

🔹 MWAA (Managed Workflows for Apache Airflow)

🔹 Apache Iceberg

🔹 Python

🔹 PySpark

🔹 Terraform

Requirements

⚠ Active and transferable SC Clearance is essential

⚠ Must be UK based

⚠ Able to work on an Inside IR35 contract

⚠ Immediate or short-notice availability highly desirable

If you're a Data Engineer looking to work on a significant Government data programme within a modern AWS environment, we'd be keen to speak with you.

📩 Apply now or contact RedRock Consulting for further details.

#DataEngineer #AWS #Python #PySpark #AWSGlue #ApacheIceberg #Terraform #DataEngineering #SCCleared #SecurityCleared #GovernmentProjects #InsideIR35 #ContractJobs #CloudEngineering #RemoteJobs #TechJobs #UKJobs #HiringNow #DataOps #AWSJobs