QA Tester with AI

Minimum experience:

• At least 4 years of experience in software quality assurance, with a focus on AI solutions..

Must have hands-on:

• Deep understanding of LLM behaviour including hallucinations, bias, edge-case handling
• Experience prompt engineering to design adversarial and robustness test cases
• Conduct photo validation and recognition tests to ensure accuracy in AI-driven quality audits.
• Able to integrate LLM-focused test suites into CI/CD pipelines (Azure DevOps, GitHub Actions)
• Experience in LLM test case generation, RAG evaluation, and use of guardrails for secure, explainable testing
• Strong background in data pipeline testing, ensuring input/output integrity of training and retrieval systems
• Expertise in managing test data, generating synthetic data, and auditing data coverage
• Document defects clearly and support triage with engineering tea