Sr Specialist - Data Engineering

• Develop IDMC CDI mappings and Taskflows against approved design documents including the DQ evaluation mapping and the DQ orchestration Taskflow nested parallelsequential Iterator pattern
• Depending on the validated approach implement rule evaluation either as parameterised source SQL with embedded rule expressions CDIonly or as CDQ assets rule specifications maplets and dictionarybased validations integrated into CDI mappings Build and maintain SQL Server database objects control tables rule library error fact tables staging tables and write productionquality TSQL for SQL tasks within Taskflows audit logging dynamic SQL assembly watermark logic dimension scoring Populate and validate the DQ rule library translating quality rules into executable rule definitions across quality dimensions
• Completeness Validity Consistency Accuracy Uniqueness Timeliness in whichever form the validated approach requires TSQL CASE expressions or CDQ rule specifications
• Execute unit testing QA integration testing and support production deployment across all three frameworks
• Work in a paired development model with the IPS Lead Developer actively absorbing platform knowledge patterns and IDMC best practices
• Participate in sprintend walkthroughs and formal knowledge transfer sessions contribute to implementation documentation
• Demonstrate independent capability by engagement end able to add a new source connection register a new DQ rule and debug a failed run using the audit log without IPS support

Required Skills and Experiences

Must have

• 7 years handson data engineering ETL development experience in enterprise environments Equal and demonstrated proficiency in both IDMC CDI and IDMC CDQ this is a dualcapability role CDI mappings Taskflows parameter sets runtime parameter overrides dynamic field propagation genericreusable mapping patterns delivered in production
• CDQ rule specifications maplets cleanseparseverifier assets dictionary based validations and binding CDQ assets to CDI mappings delivered in production
• Familiarity with the April 2026 Unified Data Quality capability DQ assets created directly within Data Integration is a strong advantage
• Advanced SQL TSQL complex queries dynamic SQL stored procedure patterns performanceaware query design on SQL Server
• Data Quality domain understanding quality dimensions rulebased validation error capture and scoring concepts
• Experience working against formal design documentation with design authority governance
• Comfortable in a paired mentored development model receptive to knowledge transfer and able to work alongside a senior external lead

Nice to have

Power BI development experience dataset design DAX measures Row Level Security useful for liaising with the Power BI track and understanding how DQ Framework output dimension scores error detail will ultimately be consumed downstream Databricks or Azure Synapse as target platforms ABFS ADLS familiarity Azure fundamentals AD groups Key Vault service principals Experience in metadatadriven controltabledriven framework builds Power BI data model awareness helpful for the dashboard track not required Automotive or manufacturing industry background

Profile attributes

Self sufficient developer who can take a designed component and deliver it with limited supervision Detailoriented this programme has formal review gates source control discipline and design signoff requirements Strong communicator in English daily collaboration with IPS Technical Lead and Data Architect Genuinely motivated to learn the engagement is deliberately structured to build lasting IDMC capability and the consultant is one of the primary recipients of that investment

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.