Data Test Lead

Key Responsibilities

• Define and lead the end-to-end data testing strategy for large-scale EDW migration programmes from legacy ETL platforms to cloud-native architectures.

• Drive source-to-target reconciliation, parallel testing, and transformation validation to ensure Azure Data Factory and dbt outputs align with existing Ab Initio processing logic and business rules.

• Design, develop, and automate robust data validation frameworks using:

o    dbt testing capabilities

o    SQL-based reconciliation techniques

o    ADF validation activities

o    Custom validation and audit frameworks

• Validate complex transformation logic, aggregations, business rules, and dimensional models across staging, curated, and reporting layers.

• Lead and mentor distributed QA and testing teams across onsite and offshore delivery models.

• Coordinate SIT, UAT, regression, reconciliation, and production validation activities.

• Track test execution progress, defect management, data quality KPIs, and testing metrics for stakeholder and programme reporting.

• Build reusable frameworks for:

o    Continuous data quality monitoring

o    Automated reconciliation

o    Data lineage validation

o    Source-to-target validation

o    Regression testing

• Collaborate closely with Data Architects, ETL Developers, Business Analysts, and Platform Teams to ensure successful migration delivery.

• Support root cause analysis and defect triage activities for data discrepancies and pipeline failures.

• Ensure adherence to enterprise governance, audit, compliance, and data quality standards.

Required Skills & Experience

• 10+ years of experience in Data Warehouse and ETL Testing, including leadership responsibilities.

• Strong understanding of ETL/ELT concepts and legacy-to-cloud migration testing methodologies.

• Extensive experience in:

o    Data validation

o    Transformation testing

o    Reconciliation testing

o    Source-to-target testing

o    Data quality assurance

• Strong knowledge of Ab Initio components and validation of graphs, mappings, and processing workflows.

• Experience testing Azure Data Factory pipelines, orchestration flows, and metadata-driven frameworks.

• Hands-on expertise in dbt including:

o    dbt tests

o    snapshots

o    SQL-based transformation validation

o    model validation

o    lineage verification

• Advanced SQL expertise with modern cloud databases such as Snowflake.

• Strong understanding of dimensional modelling and enterprise data warehousing concepts.

• Experience with defect management and test management tools such as JIRA, Azure DevOps, or equivalent.

• Strong stakeholder management, communication, and leadership capabilities.