Contract AWS Data Engineer

Contract Data Engineer - Databricks / AWS - Remote Europe

Location: Remote Central/Eastern Europe

Contract: Contract

Duration: 6 Months

Rate: Competitive contract rate

The Role

We are looking for an experienced Data Engineer to join a large-scale data platform migration for a major UK hospitality group.

The programme is migrating approximately 2PB of data and 2,400 pipelines from an Azure data estate - including Azure Data Factory, Azure SQL, Cosmos DB and Azure Databricks

• onto Databricks on AWS .

You'll join an established delivery team and work closely with the client's platform and data teams.

This is a hands-on engineering role for someone who is highly experienced with Databricks and comfortable working on complex data migration programmes.

Key Responsibilities

• Build and migrate data pipelines using Databricks, PySpark and SQL .
• Develop Databricks notebooks, DDL, transformations and automated tests.
• Migrate workloads from Azure to Databricks on AWS .
• Work within a medallion architecture governed by Unity Catalog .
• Support ingestion from SFTP, APIs and streaming via MSK .
• Perform data reconciliation and validation between legacy and target platforms.
• Run parallel processing and support production cutovers.
• Troubleshoot pipeline, data quality and migration issues.
• Work closely with architects, engineers and client teams throughout the migration.

Essential Experience

• Strong commercial experience with Databricks .
• Strong PySpark and SQL skills.
• Experience building and migrating data pipelines at scale.
• Experience with data migration, testing and reconciliation.
• Good understanding of modern lakehouse / medallion architectures.
• Experience working within Agile delivery teams.

Desirable

• AWS experience, particularly data services.
• Azure Data Factory experience.
• Unity Catalog.
• Kafka / MSK and streaming.
• API and SFTP ingestion.
• Experience migrating large-scale Azure data platforms to AWS.