AI-Enabled Automation Test Engineer

Job Title: AI-Enabled Automation Test Engineer

Location: Atlanta, GA (5 days onsite in a week)

Duration: Long Term

Job Description:

We are seeking a highly skilled Automation Test Engineer with strong expertise in Playwright, TypeScript, and AI-assisted testing practices. The ideal candidate will be responsible for building and maintaining scalable test automation frameworks, improving software quality, and leveraging AI tools to accelerate test development, execution, and defect analysis.

This role requires hands-on experience in modern test automation, Agile delivery environments, and a passion for integrating AI technologies into the QA lifecycle.

We are looking for candidate who has done Gen AI based application testing .

Automation QA Engineer with strong expertise in Playwright and modern test automation practices to validate enterprise-grade Conversational AI, Agentic AI, Chatbot, and Generative AI platforms

• Validate relevance, completeness, and correctness of generated responses.
• Define acceptance criteria for AI-generated content.
• Measure:
• Response Accuracy
• Hallucination Rate
• Grounding Accuracy
• Latency
• Context Retention
• Response Consistency
• Safety Compliance
• Support automated AI evaluation frameworks and quality scorecards.

Key Responsibilities:

• Design, develop, and maintain robust automation test frameworks using Playwright and TypeScript.

• Create and execute automated functional, regression, integration, and end-to-end test suites.

• Collaborate closely with developers, product owners, and business stakeholders to ensure product quality.

• Implement automated testing as part of CI/CD pipelines and release processes.

• Utilize AI-assisted tools to accelerate test case creation, script generation, defect analysis, and test maintenance.

• Validate web applications across multiple browsers and devices.

• Perform API testing and automate API validations.

• Analyze test results, identify root causes of failures, and work with engineering teams to resolve issues.

• Contribute to test strategy, quality processes, and continuous improvement initiatives.

• Participate actively in Agile ceremonies including sprint planning, stand-ups, backlog grooming, and retrospectives.

Required Technical Skills:

Test Automation

• Strong hands-on experience with Playwright.

• Proficiency in TypeScript/JavaScript.

• Experience building automation frameworks from scratch.

• Strong understanding of Page Object Model (POM) and automation design patterns.

• Experience automating UI, API, and end-to-end testing scenarios.

Quality Engineering

• Strong knowledge of software testing methodologies and SDLC/STLC.

• Experience with cross-browser and responsive web testing.

• Familiarity with performance, accessibility, and security testing concepts.

• Ability to define test strategies and quality gates.

AI-Enabled Testing

o Experience using AI-assisted development tools such as: GitHub Copilot, Cursor AI, Claude, ChatGPT or equivalent AI coding assistants

• Understanding of AI-driven test generation, self-healing tests, and automated defect analysis.

• Ability to leverage AI tools to improve QA productivity and test coverage.

API Testing

• Experience testing REST APIs.

• Familiarity with Postman, Playwright API testing, or similar tools.

• Understanding of authentication mechanisms, JSON payloads, and API validation techniques.

What We Are Looking For

• Strong ownership and accountability.

• Quality-first mindset with attention to detail.

• Passion for automation and continuous improvement.

• Fluent in AI-assisted coding and testing practices.

• Excellent communication and stakeholder management skills.

• Ability to thrive in a fast-paced Agile environment.

• A proactive engineer who can balance speed, quality, and innovation.