QA Automation AI Testing

Dear Candidate,

We are hiring for the below position.

Please go through the Job summary and If you are interested on this role, Please share below details.

About Zenwork- https://www.zenwork.com/

Zenwork is an AI-powered GRC (Governance, Risk, and Compliance) technology platform that automates digital tax filing, vendor onboarding, compliance management, and digital payments for businesses across the US. Our flagship platform, Tax1099, has been an IRS-authorized e-file and compliance platform since 2010, and over fifteen years we have become the market leader in digital tax compliance.Millions of businesses rely on Zenwork for compliance, and some of the biggest fintech providers in the country are our customers.We are a trailblazer in AI within our segment.We were first to launch AI tax assistance alongside live filing and transaction capabilities, and we have since shipped many agents into production.A few examples among the many innovations underway: an AI Co-Pilot that pre-fills and guides filings, Diagnostic AI that predicts audit and penalty risk before submission, AI Assist that answers over chat and voice from official IRS sources, and a Tax1099 MCP server that lets external agents validate and file securely. It shows that innovation is in our DNA.We are backed by Spectrum Equity, a leading growth equity firm, which led a $163 million growth investment in Zenwork to accelerate exactly the kind of product innovation this role drives.

Total Experience:-

Relevant Experience:-

Notice Period:-

Current CTC:-

Expected CTC:-

Role: QA Automation AI Testing

Experience : 3+ Years

Location: Hyderabad

Notice Period: Immediate / 30 Days

Work Mode: Work From Office

Job Summary :-What You Will Bring

• 3 years in QA with hands-on test automation: Python (pytest) or JavaScript (Playwright or Cypress). This is the core of the role.
• API testing experience (Postman, REST) and comfort with Git and CI pipelines.
• A working understanding of LLM behavior: non-determinism, prompt sensitivity, and hallucination, with hands-on exposure to testing or evaluating an LLM feature, chatbot, or personal AI project.
• The ability to design test datasets and rubrics for outputs that have no single correct answer.
• Strong exploratory testing instincts and crisp bug reports with reproduction steps and evidence.
• SQL to verify data pipeline outputs and scores.
• Exposure to LLM evaluation tooling such as Promptfoo, LangSmith, or DeepEval is a plus, as is fintech, tax, or compliance domain experience.

The Role

AI systems do not behave like traditional software. The same input can produce different outputs, quality is judged on rubrics rather than exact matches, and a prompt or model change can silently shift behaviour across the product. We are hiring a QA Engineer who can test both worlds: solid automation across APIs and UI, plus structured evaluation of AI outputs for accuracy, consistency, safety, and drift.You will be the quality gate for AI features that customers and internal teams rely on during the most time-sensitive weeks of the tax year.You will build automated suites, design golden datasets and evaluation rubrics for LLM outputs, and stay hands-on with exploratory testing of conversational and agentic flows that automation alone cannot cover. This is a role for someone who does both automation and manual testing well, not one or the other.

What You Will Do

• Design, build, and maintain automated test suites across API, UI, and AI-output evaluation harnesses.
• Test conversational AI end to end: chat and calling flows, intent handling, resolution quality, human-handover triggers, and sentiment tagging accuracy.
• Validate agentic workflows: multi-step agent actions such as case creation, context assembly, and recommended actions, confirming the right steps happen in the right order with the right data.
• Build golden datasets and pass/fail rubrics for model outputs such as summaries, transcripts, scores, and classifications, including hallucination and accuracy checks against ground truth.
• Run prompt and model regression cycles: replay evaluation suites on every prompt or model change and report drift with evidence.
• Perform structured manual and exploratory testing of AI conversations and edge cases automation cannot reach.
• Conduct PII leakage checks in transcripts and outputs, and sample tax-content correctness in AI responses.
• Own bug triage, curate test datasets, and keep test documentation current.

Thank You,

Syam Babu Maddirala

Sr.HR-Talent Acquisition| Zenwork

[email protected] |