AI, Data & Analytics Quality Engineer

AI, Data & Analytics Quality Engineer

Location: Remote / Hybrid Department: Information Technology Reports To: QC Test Engineering Manager

Position Summary

SourceAmerica is seeking an AI & Analytics Quality Engineer responsible for ensuring the quality, accuracy, and reliability of AI-enabled solutions, Microsoft Fabric data products, and enterprise reporting platforms.

This role will validate AI outputs, reporting solutions, data pipelines, integrations, and analytics while driving test automation to improve quality, coverage, and efficiency.

Key Responsibilities

· Test and validate AI-enabled solutions, Microsoft Copilot capabilities, and AI-generated outputs.

· Evaluate, pilot, and implement AI-enabled testing solutions to increase automation, improve test efficiency, and strengthen quality validation for AI-powered applications, data platforms, and reporting products.

· Validate Microsoft Fabric, Power BI, and enterprise reporting solutions.

· Verify data quality, business rules, calculations, KPIs, and report accuracy.

· Perform data reconciliation, source-to-target validation, and integration testing.

· Design, develop, and maintain automated tests for AI, data, and reporting solutions.

· Execute functional, integration, regression, and user acceptance testing.

· Partner with Product Owners, Data Engineers, Developers, and business stakeholders to ensure high-quality delivery.

Required Qualifications

· 5+ years of Quality Assurance, Quality Engineering, or Software Testing experience.

· 3+ years testing data, analytics, business intelligence, or reporting solutions.

· Experience testing AI-enabled applications, Copilot solutions, or AI-generated outputs.

· Experience with Microsoft Fabric, Power BI, or similar analytics platforms.

· Experience designing and implementing test automation solutions.

· Strong SQL, data validation, and analytical testing skills.

· Experience testing APIs and system integrations.

· Experience working in Agile environments.

Preferred Qualifications

· Experience with Generative AI, prompt engineering, and AI output evaluation.

· Experience with Dynamics 365 CE, Dynamics 365 F&O, Dataverse, and the Power Platform.

· Experience with test automation tools such as Playwright, Mabl, or similar frameworks.

· Experience supporting CI/CD pipelines and quality engineering practices.

· Knowledge of data governance, data lineage, and enterprise reporting.

· Microsoft Fabric, Power BI, Data Engineering, or AI certifications.

Preferred Certifications

Highly Preferred

· Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)

· Microsoft Certified: Fabric Data Engineer Associate (DP-700)

· Microsoft Certified: Azure AI Fundamentals (AI-900)

Nice to Have

· Microsoft Certified: Power BI Data Analyst Associate (PL-300)

· Microsoft Certified: Azure AI Engineer Associate (AI-102)

Education

· Bachelor’s degree in Computer Science, Information Systems, Data Analytics, Engineering, or a related field, or an equivalent combination of education and experience.

If you are interested, please share your update resume

[email protected]