Senior GenAI Quality Engineer / Solution Analyst

Summary

We are looking for a Senior GenAI Quality Engineer / Solution Analyst to design, test and validate enterprise GenAI applications across UI, APIs, data, integrations and agentic workflows.

Job Responsibilities

• Design and execute end-to-end testing for UI, APIs, integrations and GenAI/agentic applications.
• Test LLM and agent behaviour, including prompts, multi-turn conversations, tool calls, workflows and failure handling.
• Validate GenAI responses for accuracy, relevance, grounding, consistency and safe handling.
• Perform functional, integration, regression, exploratory and negative testing.
• Design and execute API testing covering authentication, validation, error handling and system integrations.
• Analyse logs, traces, API payloads and system data to identify issues and root causes.
• Develop and maintain test scenarios, test data and test automation.
• Work with developers, architects, product owners and business teams to identify quality risks and improve solutions.
• Translate business requirements into functional requirements, acceptance criteria and test scenarios.
• Support solution design and review system flows, integrations and potential risks.
• Provide quality and release recommendations based on testing results and identified risks.

Requirements

• 5–8 years of experience in Software Quality Engineering, Test Engineering or a similar role.
• Strong experience in web application, API and integration testing.
• Hands-on experience with Postman, REST Assured, pytest, Playwright, Cypress, Selenium or equivalent tools.
• Good programming knowledge in Java, Python, JavaScript or TypeScript.
• Experience testing distributed systems, APIs and enterprise integrations.
• Experience with Git, CI/CD and defect management tools.
• Good understanding of test automation, regression testing and risk-based testing.
• Experience analysing logs, API requests/responses and system failures.
• Good understanding of LLM/GenAI applications, RAG, prompts, embeddings and AI agents.
• Strong analytical and problem-solving skills with good stakeholder communication.
• Able to work in a fast-paced environment with evolving requirements.

Good to Have

• Banking or financial services experience.
• Experience with Langfuse, LangSmith, OpenTelemetry, Elastic or Splunk.
• Knowledge of Kubernetes, OpenShift, AWS or containerised applications.
• Experience in GenAI security, prompt injection or adversarial testing.
• Experience with performance, accessibility or security testing.