Senior QA Analyst

Company Description

McFadyen Digital is the leading advisor and implementer of eCommerce Marketplace solutions. During 15 years of implementing marketplaces, we’ve built dozens of platforms that cumulatively generate billions of dollars of gross merchandise value (GMV). We’re honored to have supported 10% of the Fortune 500 with their digital marketplace initiatives. Over 250 global brands like ABB, AB InBev, ACCO, Albertsons, American Red Cross, American Eagle Outfitters, US Army, US Agriculture Dept, (and many more) have entrusted their digital transformations to McFadyen. We operate global offices across the US, Brazil, and India. McFadyen Digital has been a trusted employer for over 35 years and believes that people are the most important part of our company. We’re proud of our Great Place to Work certification.

Learn more about us at our website: www.mcfadyen.com

Job Description

We are looking for a Senior QA Analyst Level 1 to work with our amazing team.

Are you a good tester? Do you enjoy solving problems? Do you love ecommerce? If you answer yes to these questions, McFadyen has an opportunity for you!

Experience: 5–7 years and Excellent Communication Skills Mandatory

Top 5 Responsibilities

• AI-Assisted Test Design & Execution
• Playwright-Based Test Automation
• Test Planning & Functional QA
• Web, Responsive & User Experience Testing
• Defect Management & Cross-Functional Collaboration

Additional Must have Responsibilities

• Leverage AI tools such as Claude, ChatGPT, or equivalent AI assistants as part of day-to-day QA activities.
• Use AI to analyze requirements, generate and refine test scenarios, identify edge cases, generate test data, analyze defects, and improve testing efficiency.
• Validate AI-generated outputs rather than blindly relying on them.
• Develop, maintain, and execute Playwright-based automated tests for functional and regression coverage.
• Use AI coding/testing assistants to accelerate automation development and improve automation coverage.
• Ensure automated tests remain aligned with verified application behavior and requirements.
• Translate requirements, user stories, and engineering notes into structured test scenarios, test cases, and test plans.
• Perform functional, integration, regression, exploratory, and release testing.
• Use requirements/tickets as the source of truth and avoid making assumptions about intended behavior.
• Test content-heavy web applications across desktop, tablet, and mobile.
• Validate search, navigation, content rendering, filters, editors, threads, comments, notifications, links, permissions, and other user journeys.
• Identify usability, functional, content, and responsive issues.
• Identify, reproduce, document, and track defects with clear steps, expected vs. actual results, severity, and supporting evidence.
• Work closely with Product and Engineering teams to clarify requirements, resolve defects, address blockers, and support release readiness.
• Clearly distinguish confirmed defects from requirement/design ambiguity and escalate where clarification is required.

Top 5 — Good to Have Responsibilities

• AI Agentic QA & Workflow Development

• Experience creating or using AI-powered QA workflows/agents for requirement analysis, test generation, UI exploration, test-data generation, defect analysis, or test-result analysis.

• Exposure to Playwright MCP or similar agentic testing approaches.

• API & Technical Testing

• Experience with API testing and browser Developer Tools.

• Ability to inspect network requests, API responses, console errors, DOM state, and other technical information to troubleshoot issues.

• QA Metrics & Quality Analytics

• Track metrics such as test coverage, automation coverage, execution trends, defect leakage, defect trends, regression effectiveness, and release quality.

• Use AI to identify patterns, anomalies, and recurring quality issues.

• Programming & Automation Engineering

• Working knowledge of JavaScript/TypeScript or Python.

• Understanding of automation framework structure, reusable components, dynamic test data, and test maintainability.

• CI/CD & DevOps

• Familiarity with Git/GitHub, GitHub Actions/Jenkins, Docker, and CI/CD concepts.

• Ability to execute and troubleshoot automated tests as part of CI/CD pipelines.

Rest — Additional / Nice to Have

• Experience testing AI/LLM applications, including response validation, hallucination testing, RAG testing, and AI evaluation.
• Experience with AI coding assistants and agentic development tools.
• Experience developing reusable AI prompts, skills, agents, and workflows.
• Experience with AI-assisted test-case and automation generation.
• Exposure to performance testing and tools such as JMeter/BlazeMeter.
• Experience with Selenium, Cypress, or other automation frameworks.
• Experience with Kubernetes.
• Experience building QA dashboards and quality analytics.
• Experience using AI for test-result and production-data analysis.
• Prior experience in a startup or fast-iterating product environment.

What We Can Offer You:

• A career in digital marketplaces and platform businesses.
• A career with first movers who are deploying new business models and strategies worldwide.
• A career with thought leaders who literally wrote the book on Marketplace Best Practices.
• A career in the fast-paced world of retail eCommerce.
• A career in a flat management structure without a rigid hierarchy and bureaucracy.
• A career in a culture that rewards creativity and innovation, risk-taking and teamwork.

Additional Information:

Our Core Values: Caring, Adaptable, Proactive Ownership, Empowering Clients

Keywords: Quality Assurance, E-commerce, Marketplace, Software Testing, Test Scripts, Bug Reporting, Playwright, Selenium, Automation Testing, API Testing, Postman, JMeter, Claude, Generative AI, AI-Assisted Testing

eCommerce & Marketplace Platforms: Adobe Commerce (Magento), Salesforce Commerce Cloud (SFCC), SAP Hybris, Mirakl, ChannelAdvisor, IBM WebSphere Commerce, BigCommerce, Shopify Plus, commercetools, Oracle Commerce, Elastic Path, Spryker

Technology & Tools: CRM (Salesforce), SaaS Sales, PIM (Product Information Management), CPQ (Configure Price Quote), CMS (Content Management Systems), OMS (Order Management Systems), ERP (Enterprise Resource Planning), BI Tools (Business Intelligence)

QA Technology & Tools: Playwright, Selenium WebDriver, Postman, SoapUI, JMeter, JIRA, CI/CD, Test Automation Frameworks, Claude, Generative AI Tools, AI-Assisted Testing Tools