A
Anaplan
Senior QA Automation Engineer (Artificial Intelligence)
Skills
PythonTesting & QAPostmanSeleniumAIJavascript
14 days ago
Share this opportunity
Share this opportunity to other talents of your network:
✓ Offer them a visibility boost with clients.
✓ Help your contacts find their next job.
Important information
Contract type:
Permanent
Location:
London, UK
Work mode:
Onsite
Published on:
7 October 2026
What they need
- We’re pioneering a new role focused exclusively on quality assurance for GenAI/Agentic systems. As our Senior SDET for AI, you’ll develop testing strategies, evaluation frameworks, and quality metrics specifically designed for LLM-powered applications. This role requires a unique blend of QA expertise, understanding of GenAI behaviour, and automation skills to ensure our AI features are reliable, accurate, and trustworthy
- Design and architect comprehensive test plans, evaluation frameworks, and quality metrics designed specifically for LLM-powered applications and agentic workflows
- Develop robust, end-to-end automated test suites in Python across evaluations, API checks, UI checks, and performance tests
- Create automated prompt testing systems and regression suites to proactively detect unintended changes in model behaviour
- Establish multi-dimensional evaluation criteria to measure and track GenAI quality across accuracy, relevance, safety, consistency, and latency
- Perform adversarial testing (red-teaming) to identify and mitigate model hallucinations, biases, or security vulnerabilities
- Develop internal tools and testing frameworks that enable software engineering teams to seamlessly validate their own GenAI implementations
- Deploy real-time monitoring and alerting systems to quickly detect and flag quality degradation of AI features in production
- Own the overall quality and testing strategy for your workstream, maintaining high-fidelity test datasets (“golden examples”) and defining QA best practices- Deep understanding of GenAI technologies including LLMs, prompt engineering, and AI application patterns
- Strong hands-on Python coding experience
- Strong analytical and problem-solving skills with attention to detail
- Strong experience with CI/CD pipelines and automated testing integration
- Strong background of software testing methodologies (functional, integration, regression, performance, security testing)
- Proven ability to design test cases and evaluation criteria for non-deterministic systems
- Expert experience with test automation frameworks and scripting (Python, JavaScript, Selenium, Pytest)
- Experience with API testing tools (Postman, REST Assured) and backend testing
Other offers great for you!
These companies are also looking for great profiles
T
Tenth Revolution Group
QA Engineer
Freelance
Ghent, Belgium
Hybrid
Skills
QA Engineer
2 months ago
Quick apply
N
Nexoris
Senior Salesforce QA Engineer
575
Freelance
Paris, France
Hybrid
Skills
logs et architectures microservices. - GitHub Copilot (contexte d’utilisation pour la génération de tests).- Quality Assurance / Quality Engineering - Définition de stratégies de tests. - Approche Shift Left. - Gestion des risques qualité. - Tests fonctionnels et End-to-End. - Environnements Salesforce Sales Cloud. - Connaissance Customer Cloud appréciée. Compétences techniques - Salesforce (Sales Cloud impératif). - Playwright. - TypeScript. - Automatisation de tests Web et API. - Jira Xray. - Suite Atlassian. - Analyse d’APIslogs et architectures microservices. - GitHub Copilot (contexte d’utilisation pour la génération de tests).- Quality Assurance / Quality Engineering - Définition de stratégies de tests. - Approche Shift Left. - Gestion des risques qualité. - Tests fonctionnels et End-to-End. - Environnements Salesforce Sales Cloud. - Connaissance Customer Cloud appréciée. Compétences techniques - Salesforce (Sales Cloud impératif). - Playwright. - TypeScript. - Automatisation de tests Web et API. - Jira Xray. - Suite Atlassian. - Analyse d’APIs
8 days ago
Quick apply
C
Caboost
QA Engineer / Testeur Fonctionnel & Automatisation (H/F) - AO880
330
Freelance
Lille, France
Hybrid
Skills
Testing & QAPostmanCypress
4 hours ago
Quick apply
No company information available.