Sr Manual QA Engineer (AI / LLM & API Testing)

Job Summary

Ciklum is looking for a Senior Manual QA Engineer (AI / LLM API Testing) to join our team full-time in India.

As a Senior Manual QA Engineer (AI / LLM API Testing), become a part of a cross-functional development team engineering experiences of tomorrow. We are seeking a Senior Manual QA Engineer (AI / LLM API Testing) with 6+ years of experience in QA engineering. The ideal candidate will have strong expertise in API testing, test automation frameworks, and CI pipeline integration, with added exposure to RAG/LLM output evaluation and multilingual testing. This role is central to ensuring quality across the platform, defining test strategies, and validating outputs across multiple systems and languages.

Responsibilities

• Own quality assurance across the platform, including:
  • Retrieval accuracy and relevance testing
  • Multilingual output validation across German, Italian, French, and Dutch
  • NICE sync and writeback verification with versioning and deprecation handling
  • API contract testing for the portal and Boost.ai consumers
  • Regression coverage for the agent triage surface
• Define test strategy and acceptance criteria with the Business Analyst (BA) against the Phase 1 scope
• Collaborate with engineering teams to integrate QA processes into CI/CD pipelines
• Ensure consistent quality across multilingual environments and AI-driven outputs

Requirements

• 3+ years of experience in QA engineering
• Hands-on experience with test automation frameworks (pytest or equivalent)
• Strong API testing skills using Postman or REST-based tools
• Experience with CI pipeline integration
• Exposure to RAG or LLM output evaluation is a plus
• Experience with multilingual testing (German, Italian, French, Dutch) is highly valued
• Tech stack: test automation frameworks, API testing (Postman/REST), CI integration

Desirable

• Strong analytical and problem-solving skills
• Ability to define clear acceptance criteria and test strategies
• Detail-oriented with a focus on accuracy and consistency
• Collaborative mindset with the ability to work closely with BAs, developers, and leads
• Passion for ensuring high-quality user experiences across diverse environments

Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.