AI QA Automation

Job highlights

• . AI / LLM Testing: Experience testing LLM applications,RAG (Retrieval-Augmented Generation) pipelines,or NLP models
• Required Skills
• Skills. experience

Job Details

Job Title*

AI QA

Client Budget *

30 lacs

Job Start Date

States*

Haryana

Location* (Location with city or zip code)

Gurugram

Client Name*

Turing

Client Manager*

Vinal

Priority*

High

Placement Fee Percentage*

5-15%

Placement Type*

Fulltime

Skills

experience*

7+

Primary Skills*

QA, Automation,LLM,RAG

Organizational Information

Number of Positions*

1

Business Leader (L1)*

Disha Sharma

Assigned To*

Irtiqua

Account Manager (L2)

Priety Priyanka Dubey

Required Skills

• AI/LLM Testing: Experience testing LLM applications, RAG (Retrieval-Augmented Generation) pipelines, or NLP models. Familiarity with AI evaluation frameworks (e.g., LangSmith, DeepEval, or similar).
• Languages: Strong proficiency in Python 3.12+ (crucial for integrating with the existing AI backend and Pytest suite). Secondary experience with JavaScript/TypeScript.
• Test Automation: Expertise in API testing (REST) and optional UI automation using Playwright.
• Data & Search: Understanding of Vector Databases (e.g., Milvus, Pinecone) and semantic search concepts (embeddings, hybrid search).
• Data & SQL Validation: Solid understanding of SQL and data validation techniques to verify correctness of complex query outputs.
• Tools & Infrastructure: Git, Docker, CI/CD pipelines, and observability tools (Prometheus/Grafana).

Education

• BE / BTech / MCA / BSc in Computer Science, Data Science, or a related field.

Nice to Have

• Familiarity with Graph Databases (Neo4j) and LangGraph orchestration.
• Experience evaluating foundational LLM models (OpenAI, Anthropic, Google).
• Prior exposure to query languages like SQL or PURE or any other functional programming language.
• Experience testing workflows across multiple services or pipelines, with an understanding of failure handling, retries, and system reliability concepts.
• Experience in Banking, Financial Services, or Insurance domains
• Understanding of data security, compliance, and enterprise database schemas

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.