Software Test Engineer - AI Automation

Location: Hyderabad
Qualification: Bachelors degree in Computer Science, Information Technology, Quality Assurance, or related field
Job description:
Strong proficiency in test automation frameworks and programmings languages (Python, JavaScript/TypeScript);
Experience testing RESTful APIs, webhooks, and integration layers across enterprise systems;
¢ Familiarity with Agentic AI platforms and conversational AI testing methodologies;
¢ Understanding of MCP server validation, A2A orchestration testing, and AI agent behavior verification;
¢ Knowledge of NLU/intent testing: precision, recall, F1 scoring, utterance coverage, and entity extraction validation;
¢ Experience with CI/CDintegrated test pipelines (GitHub Actions, Azure DevOps Pipelines, Jenkins);
¢ Proficiency with defect tracking and test management tools (Jira, Azure DevOps, TestRail, or similar);
¢ Understanding of performance/load testing tools (JMeter, k6, Locust) for AI platform scalability validation;
¢ Familiarity with ServiceNow, Workday, and identity management system testing;
¢ Understanding of data privacy, security testing, and compliance validation in AIdriven workflows;
¢ Strong analytical, documentation, and crossfunctional communication skills.
Skills
¢ Experience in QA engineering, test automation, or software quality assurance;
¢ Experience testing conversational AI / chatbot / virtual assistant platforms (Leena AI, Moveworks, or similar) preferred;
¢ Handson experience with API testing tools (Postman, Newman, RESTassured) and test automation frameworks (Selenium, pytest, Cypress, or similar);
¢ Familiarity with Agentic AI concepts, LLM output validation, and nondeterministic testing strategies is a plus;