QA Tester - AI

Senior Quality Automation Engineer (UI & API & AI Validation) About The Role We are looking for a Senior Quality Automation Engineer with strong experience in modern test automation, backend validation, and AI-driven application testing.

You will work across UI/API automation, event-driven microservices, and GenAI evaluation workflows to ensure high-quality releases across distributed systems.

Key Responsibilities Automation Engineering

• Build and maintain scalable UI and API automation frameworks using Playwright (TypeScript/JavaScript or Python).
• Integrate automated tests into CI/CD pipelines.
• Improve execution speed, reliability, and reduce flaky tests.

Backend & Event-Driven Testing

• Validate asynchronous workflows and distributed systems using Kafka or similar messaging platforms.
• Implement contract testing and schema validation to ensure reliable communication between microservices.
• Verify event publishing, consumption, and end-to-end data integrity.

AI & LLM Validation

• Test and evaluate GenAI/LLM-based features for accuracy, relevance, and hallucination handling.
• Work with evaluation frameworks such as Ragas, LangSmith, or TruLens.
• Build and maintain datasets for regression and prompt validation.

Collaboration

• Work closely with developers, AI engineers, and product teams to define quality strategies.
• Participate in architecture, API, and prompt design discussions.

Required Skills

• 5+ years of experience in QA Automation or Software Testing.
• Strong hands-on experience with Playwright.
• Experience testing APIs, microservices, and event-driven systems.
• Good understanding of Kafka, contract testing, and schema validation.
• Exposure to AI/LLM testing and RAG-based applications.
• Proficiency in TypeScript, JavaScript, or Python.
• Experience with CI/CD pipelines, Docker, and Kubernetes is a plus.