QA Engineer – Agentic Gateway Testing

About the Client

Our client is a large global enterprise operating across multiple markets, with a complex technology landscape and a strong focus on digital transformation and innovation. The organization is actively investing in modern cloud, data, and AI capabilities to enable scalable, secure, and highly automated solutions across its business.

About the Project

The project is focused on building an enterprise-grade AI Agent Platform from the ground up. The platform will provide a standardized foundation for developing, deploying, orchestrating, securing, and observing AI agents across multiple teams and use cases.

The initiative covers the full agent lifecycle and brings together agent orchestration, observability, security, governance, integrations, evaluation, and platform engineering. Engineers joining the project will have an opportunity to influence key architectural and technical decisions and contribute to a new platform rather than maintaining an existing solution.

What you will do

• Design and execute tests for agentic workflows , including tool discovery, tool invocation, and multi-step agent interactions.
• Validate MCP protocol behavior , including tool list aggregation, tool-call routing, and streaming responses.
• Test authorization and authentication controls , including unauthorized tool-access scenarios and policy-enforcement validation.
• Perform performance testing for agentic workloads, including tool-discovery latency, concurrent agent sessions, and agent-to-agent communication latency.
• Build and maintain automated tests in Python using pytest , including asynchronous testing, mock MCP servers, and agent workflow simulations.
• Validate agentic observability , including trace completeness, agent-step logging, and audit trails.
• Perform end-to-end testing across agent, gateway, and tool interaction flows.
• Identify reliability, security, and performance issues in complex agent workflows and support their resolution.

What you need for this

Skills:

• Agentic workflow testing — agent tool discovery, tool invocation, multi-step agent workflows

• MCP protocol testing — tool list aggregation, tool call routing, streaming response handling

• Agent authorization testing — unauthorized tool access attempts, policy enforcement validation

• Agent performance testing — tool discovery latency, concurrent agent sessions, agent-to-agent latency

• Python test automation — pytest with async, mock MCP servers, agent workflow simulation

• Agentic observability validation — trace completeness, agent step logging, audit trail verification

Experience:

• 4+ years QA engineering for AI/ML or agent systems

• Tested LLM agent workflows (tool calling, multi-step reasoning)

• Security testing for authorization and authentication

• Performance benchmarking for cloud services

Nice to have:

• MCP protocol testing experience

• Agent framework testing (LangChain, LangGraph, Crew)

• AWS Bedrock Agents testing

• Chaos engineering for agentic systems

• Audit log validation (CloudTrail, OpenTelemetry traces)