QA Engineer

About the Company

We are an AI company building healthcare technology products for the US market. Our platform integrates directly with hospitals, healthcare providers, and payers, handling sensitive health data on their behalf. As we prepare to bring our product to market, security and regulatory compliance are foundational to everything we do — they are prerequisites for launch, not afterthoughts.

Key Responsibilities:

Own the QA function

• Define and implement the testing strategy, standards, and release criteria for the Islamabad engineering team.
• Build and maintain regression, smoke, and integration test suites; introduce a defect lifecycle and quality reporting the leadership team can act on.
• Serve as the quality gate for releases — define what “ready to ship” means and enforce it.

Test automation and engineering

• Design and maintain automated test frameworks for web UI, REST APIs, and backend services using Python-based tooling.
• Integrate automated testing into CI/CD so defects surface before merge, not after deployment.
• Perform API, database, and performance/load testing across microservices and cloud environments.

AI/ML and data quality

• Validate AI/ML components: model output accuracy, consistency, edge-case and boundary behavior, regression across model versions, and degradation over time.
• Test data pipelines end to end — ingestion, transformation, and reporting — for completeness and integrity.
• Design evaluation approaches for non-deterministic outputs, where correctness is measured statistically rather than by exact match.

Collaboration and compliance

• Work embedded with Backend, Frontend, AI, and Python developers from requirements through release; review specifications early to catch ambiguity before it becomes a defect.
• Ensure testing practices align with healthcare data-protection expectations (HIPAA / PHI handling) and support validation and audit-readiness requirements for a CLIA/CAP-accredited environment.
• Document test evidence to a standard that withstands external review.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Software Engineering, or a closely related field.
• 5+ years in software quality assurance, with at least 2 years in test automation (not manual-only).
• Strong Python — able to build and own a test framework independently, not only edit existing scripts.
• Hands-on with at least one modern automation framework: Pytest, Playwright, Selenium, or Cypress.
• Solid API testing (Postman, REST Assured, or equivalent) and strong SQL for data validation.
• Working knowledge of CI/CD pipelines (GitHub Actions, Jenkins, or GitLab CI) and Git.
• Demonstrated understanding of the ML lifecycle — training, evaluation metrics, versioning, and drift — sufficient to design meaningful tests around model behavior.
• Clear written English; able to document findings for both engineers and non-technical stakeholders.

Preferred Qualifications

• Experience testing AI/ML-powered or data-intensive products.
• Familiarity with LLM/model evaluation tooling (e.g. DeepEval, Ragas, promptfoo) or custom evaluation harnesses.
• Exposure to healthcare IT: HL7/FHIR, LIS/LIMS, EMR integrations, or regulated software validation.
• Performance and security testing (JMeter, OWASP ZAP); cloud experience (AWS/Azure); Docker.
• ISTQB certification.

Equal Opportunity Statement

We are committed to diversity and inclusivity.

Pay: From Rs200,000.00 per month

Work Location: In person