Data Engineering Lead (AWS / Databricks)

Data Engineering Lead

TalentCo are delighted to be partnering with an established SaaS business at the forefront of secure customer engagement and Conversational AI, looking to hire a high-calibre Data Engineering Lead into their growing product organisation.

The core role of the Data Engineering Lead will be to lead the design, delivery and long-term ownership of a greenfield Databricks Data Lakehouse that will underpin reporting, analytics, AI and customer-facing data products.

You'll build and lead a multidisciplinary data function across engineering, analytics engineering, BI and data quality, while remaining hands-on with architecture and technical direction. You'll also work closely with an external delivery partner during the initial build phase, ensuring knowledge transfer, engineering excellence and a seamless transition to an internally owned platform.

This hire can be based remote-first in the UK, with occasional travel to their HQ (just north of London) as required.

As Data Engineering Lead you will:

• Lead, mentor and grow a multidisciplinary data team spanning Data Engineering, Analytics Engineering, BI and Data Quality.
• Own the architecture and technical direction of a greenfield Databricks Lakehouse platform on AWS.
• Drive delivery across the product roadmap while establishing engineering best practices, platform reliability and operational excellence.
• Partner with internal stakeholders and external delivery teams to successfully build, transition and scale the platform.
• Champion data governance, security, platform performance and cloud cost optimisation across a modern enterprise data estate.

We want to hear from you if:

• You have a hands-on Data Engineering / Architecture background with experience leading data teams and developing high-performing people.
• You have plenty of experience with Databricks, ideally having built or operated a Databricks-based including Delta Lake and Unity Catalog, alongside the AWS data ecosystem.
• You're comfortable providing architectural leadership while remaining technically credible in Python, PySpark and SQL.
• You have experience delivering modern cloud data platforms within Agile product engineering environments.
• You've worked with data governance, compliance and regulated environments, alongside external delivery or consulting partners.

What do they offer?

• Base salary up to £100k
• Comprehensive benefits package
• Remote-first working with flexible arrangements
• Opportunity to lead a business-critical greenfield Data platform build from day one