LLM evaluation Lead- data Scientist

Job highlights

• 8+ years experience with deep understanding of LLM behavior, prompt sensitivity, hallucination analysis, and expertise in tools like Ragas, DeepEval, TruLens
• Own evaluation strategy, conduct red-teaming and adversarial prompt design, track vendor model comparisons, and act as bridge between Data Science and Product

LLM Evaluation Lead (Applied Scientist) 8+ Years

Key Skills:

• Deep understanding of LLM behavior & failure modes
• Prompt sensitivity, hallucination analysis, RAG failure modes
• Evaluation strategy ownership (offline & online)
• Tools: Ragas, DeepEval, TruLens
• Red-teaming & adversarial prompt design
• Vendor model comparison tracking
• Bridge between Data Science & Product