Quality Engineer

Req ID: phone_number

We are currently seeking a Quality Engineer to join our team in Remote, Karnataka (IN-KA), India (IN).

Responsibilities

• Lead the discovery (Current state) and Documentation that will produce 5 deliverables:
• Enterprise Testing Strategy
• QE Handbook
• Automation Handbook
• Perf Engineering Handbook
• Test Enablers
• Evaluate and maintain the testing strategies, approaches, tools and frameworks used by the teams.
• Design, develop and execute test automation frameworks and test automation suites.
• Provide regular quality and status reports.
• Participate in project-wide reviews of requirements, system architecture and detailed design documents.
• Act as key point of contact for other Quality Engineers across multiple teams.
• Identify and resolve issues that arise when integrating the application software with other software components.
• Mentor and guide other Quality Engineers on the QA Process, the testing strategy, tools and frameworks being used and assist them in growing their careers.
• Conduct regular performance reviews and conduct interviews.
• Develop testing strategies for AI-generated outputs: structured extraction accuracy measurement, confidence score calibration validation, and regression testing across model or prompt changes
• Design test harnesses for non-deterministic LLM outputs define acceptable output schemas, boundary conditions, and automated assertion patterns that account for natural response variation
• Build integration test suites for the RAG pipeline: retrieval precision/recall measurement, embedding drift detection, and few-shot example quality validation
• Author contract tests for all external integration adapters to detect upstream API changes before they reach production; experience with consumer-driven contract testing patterns (e.g., Pact) a plus
• Design and execute performance tests against LLM inference endpoints to validate throughput, latency SLAs, and GPU utilization under concurrent engineer load
• Develop test cases for human-in-the-loop workflow paths: review queue routing logic, SME correction capture, override persistence, and RAG index update verification
• Experience testing event-driven or workflow-orchestrated systems (Temporal.io, Azure Durable Functions) a plus
• Experience using agentic AI tools for test generation (co-pilot-assisted test authoring, AI-generated test data) in daily QE workflows is a plus