AI Chatbot Quality Engineer

Role: AI Chatbot Quality Engineer

Location: Brampton, ON – Hybrid

Contract Role

Job Description

Key Roles Responsibilities Validate chatbot responses for accuracy| relevance| completeness| and consistency. Create and execute test scenarios| test cases| and regression test suites. Identify hallucinations| incorrect responses| formatting issues| and knowledge gaps. Perform chatbot conversation analysis and recommend quality improvements. Develop and maintain test automation for chatbot validation where possible. Work closely with developers| AI engineers| and content teams to resolve defects. Track| document| and report defects| test results| and quality metrics. Support UAT| release validation| and production quality monitoring. Key Skillsets5 Yrs of strong QA SDET Test Automation experience. Experience testing AI| LLM| GenAI| chatbots| virtual assistants| or conversational platforms. Knowledge of prompt engineering concepts Experience with Jira| Confluence| GitHub| and Agile delivery. Experience with API testing and automation frameworks. Strong analytical and troubleshooting skills. Experience with Python| Selenium| Playwright| PyTest| or similar tools. Strong communication and documentation skills.