Lead Data Quality Engineer

Location: Hyderabad / Kolkata

Experience: 7–11 Years

Employment Type: Full-Time

Company: Finarb Analytics Consulting Pvt. Ltd.

About Finarb

Finarb Analytics Consulting is a data, analytics, and AI consulting firm delivering enterprise solutions across data engineering, business intelligence, cloud modernization, and advanced analytics.

About the Role

We are looking for an experienced, hands-on Lead Data Quality Engineer to drive data validation, reconciliation, and quality automation across enterprise data platforms.

The ideal candidate will have strong expertise in SQL, ETL/ELT testing, data quality automation, and data warehousing , with experience in Azure-based environments and preferably Microsoft Fabric.

The role involves leading data quality initiatives, developing automated validation frameworks, ensuring data integrity during platform migrations, and mentoring junior engineers.

Key Responsibilities

• Lead data quality engineering, validation, and reconciliation activities across enterprise data platforms.
• Design and implement automated data quality testing frameworks using SQL and Python.
• Develop complex SQL queries for source-to-target reconciliation, transformation validation, and data integrity checks.
• Validate ETL/ELT pipelines, including full loads, incremental loads, CDC, and complex transformations.
• Lead data validation and reconciliation during migration from SQL Server and Azure Data Factory to Microsoft Fabric.
• Establish data quality standards, testing strategies, and automated monitoring processes.
• Investigate production data discrepancies, perform root cause analysis, and implement preventive controls.
• Collaborate with data engineers, architects, and BI developers to ensure data accuracy and reliability.
• Mentor data quality engineers, conduct technical reviews, and drive engineering best practices.

Required Skills & Qualifications

• 7–11 years of experience in data quality engineering, ETL testing, or data warehouse testing.
• Advanced SQL/T-SQL skills, including complex joins, CTEs, window functions, and query optimization.
• Strong experience in ETL/ELT testing, source-to-target validation, and data reconciliation .
• Hands-on experience developing automated data quality frameworks using SQL and Python .
• Strong understanding of data warehousing, dimensional modeling, and transformation logic.
• Experience with SQL Server, Azure Data Factory, and Azure data environments .
• Proven ability to troubleshoot complex data discrepancies and production issues.
• Experience leading technical teams, reviewing code, and establishing testing standards.
• Bachelor's degree in Computer Science, Engineering, or a related field.

Good-to-Have Skills

• Microsoft Fabric (Lakehouse, Warehouse, OneLake, Fabric Data Factory).
• PySpark and Spark SQL.
• Data quality tools such as Great Expectations, Soda, or dbt tests.
• Delta Lake and medallion architecture.
• Azure DevOps, Git, and CI/CD.
• Experience with cloud data migration and modernization projects.
• Power BI data validation and Microsoft Purview.

What We're Looking For

A technically strong, hands-on engineering lead who can independently design scalable data quality solutions, automate complex reconciliation processes, and ensure data accuracy across enterprise systems.

Candidates with experience in large-scale data migrations, automated testing frameworks, and Microsoft Fabric will be preferred.

Why Join Finarb?

• Work on enterprise-scale data engineering and cloud modernization projects.
• Gain exposure to Microsoft Fabric and modern data platforms.
• Lead data quality engineering initiatives and influence technical standards.
• Collaborate with experienced data architects and engineering teams.

Company Website: https://www.finarb.ai