QA Tester / QA Developer

QA Automation Engineer | Fintech

About Us

We are building the future of finance, an AI-native fintech platform that leverages large language models (LLMs) and autonomous agents to re-imagine financial services. Financial systems require extreme precision, low latency, and uncompromised compliance. We are seeking a QA Automation Engineer who can build robust testing infrastructures capable of validating both deterministic core financial engines and non-deterministic AI agentic behaviors.

The Role

In this position, you won't just write basic UI scripts or API assertion checks. You will write test cases that evaluates real-time financial transactions, complex API contracts, and the safety, accuracy, and performance of our AI models and workflows.

Core Responsibilities

1. AI & LLM System Evaluation

• Design, implement, and maintain LLM evaluation harnesses to measure output accuracy, factual grounding, hallucination rates, and safety guardrails across our AI features.
• Test agentic workflows for proper tool calling, multi-step financial reasoning, and fallback behaviors.
• Execute regression testing strategies for model upgrades, prompt changes, and system prompt iterations.

2. Fintech Core & API Test Automation

• Build and scale automated test suites for REST/GraphQL APIs, microservices, and distributed ledgers.
• Create deterministic data assertion checks for balance calculations, double-entry ledgers, interest routines, and transaction pipelines.
• Ensure strict adherence to security protocols (OAuth2, mTLS, encryption, PII masking) and regulatory standards (PCI-DSS, SOC 2, KYC/AML).

3. E2E & Infrastructure Integration

• Build scalable E2E automation frameworks using Playwright, Cypress, or Python (PyTest) integrated into modern CI/CD pipelines.
• Implement synthetic data generation strategies to safely mimic realistic financial customer interactions without using production PII.
• Conduct load, stress, and latency testing on critical financial execution paths.

Key Requirements

• Experience: 4+ years in Test Automation / SDET roles, with at least 1–2 years working in Fintech or high-compliance environments.
• AI/LLM Testing: Hands-on experience evaluating GenAI models or agentic workflows (using frameworks like DeepEval, Ragas, Promptfoo, or custom Python eval scripts).
• Programming: Strong proficiency in Python or TypeScript/JavaScript.
• API & System Testing: Expertise in API automation (Postman, Requests, Playwright API), schema/contract validation, and asynchronous event testing (Kafka, RabbitMQ, WebSockets).
• CI/CD & Cloud: Deep understanding of Docker, GitHub Actions / GitLab CI, and AWS/GCP cloud environments.
• Fintech Mindset: Obsession with edge cases, edge-value numerical precision, and race conditions in financial logic.