Software Engineer in Test III - GenAI

Responsibilities

• Validate complex system workflows across UI, API, and backend layers, ensuring correctness, reliability, and consistency of every release
• Enhance and maintain the existing Playwright automation framework, expanding UI/API coverage and improving reliability, flakiness detection, and execution efficiency
• Build internal QA tools, improve test data workflows, and contribute to CI/CD quality gates and overall pipeline readiness
• Develop and maintain test infrastructure for containerized and distributed environments (Docker, Kubernetes)
• Conduct performance, load, and scalability testing for high-traffic services using k6 or similar tools
• Collaborate closely with engineering, product, LeadGen, Payments, and design teams to embed quality early in the lifecycle
• Analyze failures across distributed systems using observability platforms (logs, metrics, dashboards) to identify root causes quickly
• Advocate for shift-left quality and influence system design and architecture for better testability
• Maintain accurate documentation and onboarding materials for frameworks, tooling, and best practices

Requirements

• 4+ years of experience in software testing or automation for SaaS, web applications, or distributed systems
• Expertise in enhancing and maintaining automation frameworks (Playwright or equivalent)
• Proficiency in TypeScript, JavaScript, or Python for scalable automation development
• Hands-on experience with CI/CD pipelines and containerized infrastructure (Docker, Kubernetes)
• Working knowledge of AWS or GCP environments
• Deep understanding of RESTful API testing, backend validation, mocks/stubs, and integration testing
• Experience with performance and load testing tools like k6, Locust, or JMeter
• Familiarity with observability tools such as Grafana, Prometheus, ELK, or OpenTelemetry
• Strong debugging skills, especially in distributed and microservices-based architectures
• E-Commerce domain experience (preferred but optional)
• Basic knowledge of AI-driven testing techniques or LLM-based test generation
• Excellent communication, documentation, and problem-solving abilities

Nice To Have

• Experience validating E-Commerce flows such as checkout, order lifecycle, payments, taxes, pricing rules, and inventory synchronisation
• Experience analysing and testing AI/LLM-powered features, including prompt validation, hallucination detection, model consistency checks, and AI-assisted testing workflows

Skills: test automation framework,automation,eval,testing,rag,llm