Data SDET / Lead Data Quality Engineer

Data SDET / Lead Data Quality Engineer | Management Consulting | Asset Management | London (Hybrid)

📌 Buy-side Asset Management or Wealth Management domain experience required

💷 £80,000 to £120,000 per annum (Permanent), plus comprehensive corporate benefits package.

🏠 London Hybrid (3 days per week at City of London office, Bank / Cheapside area).

👥 Specialist Data & Quality Practice supporting a major global asset manager.

🏢 Boutique Financial Services Consultancy driving a multi-year middle-office data transformation.

💻 Azure Databricks, PySpark, Delta Lake, Azure Data Factory, Medallion Architecture, SQL, Python.

A fast-growing boutique financial services management consultancy is partnering with a major global asset management platform undergoing a multi-year middle-office transformation. As part of building out a centralised cloud Data Lakehouse (IBOR data spine: holdings, transactions, securities, and pricing), they are seeking high-calibre Data SDETs and Lead Data QA Engineers to validate modern cloud data pipelines from end to end.

This is a Permanent or Fixed-Term Contract (FTC) opportunity designed for long-term career growth within a specialist digital delivery practice.

As the successful candidate, you will:

Take ownership of data pipeline quality engineering: Design, build, and execute automated test frameworks across cloud data platforms (Azure Databricks, Delta Lake, Azure Data Factory).

Validate multi-layered Lakehouse data flows: Test transformations across Bronze, Silver, and Gold Medallion layers, ensuring business logic, data reconciliation, schema validation, and SCD Type 2 handling remain rock-solid.

Perform source-to-target mapping & reconciliation: Validate data integrity across complex financial datasets, including investment book of record (IBOR), portfolio holdings, transactions, and upstream market data feed ingestions.

Act as a technical quality gate: Partner directly with Data Engineers, Cloud Architects, and Business Stakeholders to review technical proposals, manage test releases, and validate legacy platform migrations to the cloud.

Candidate Requirements

Required

• Strong background in Data QA / Data Engineering testing within buy-side Asset Management, Wealth Management, or Capital Markets environments.

• Hands-on expertise validating cloud data pipelines built on Azure Databricks, PySpark, Spark SQL, Delta Lake, and Azure Data Factory.

• Proven experience testing Medallion architectures and automated source-to-target ETL/ELT transformations using Python or SQL.

• Confidence operating as a self-directed Technical Tester / QA Lead in Agile delivery setups.

• Comfortable committing to 3 days/week onsite in the City of London (Bank / Moorgate area).

• Open to Permanent or Fixed-Term Contract (FTC) engagement models .

Nice to Have / Ideal

• Experience with legacy DWH/ETL migrations (e.g., SAP BODS, SSMS, or mainframe to Databricks Lakehouse).

This is an exceptional opportunity to join a high-growth consultancy delivering high-impact cloud data initiatives across major global financial institutions.

This vacancy is being managed by a third-party recruiter. By applying, you agree to your application being processed for this role. We endeavour to respond to all candidates, but high application volumes may prevent individual feedback.