LLM Evaluation Lead (Applied Scientist)

Job Summary

We are looking for a Senior Generative AI Engineer with strong hands-on experience in AI/ML and LLM technologies. The role requires excellent communication, leadership skills, and deep coding expertise to build and deploy enterprise Gen AI solutions.

Key Responsibilities

• Design and develop Generative AI and LLM-based solutions
• Implement RAG pipelines, AI agents, prompt engineering, and knowledge systems
• Integrate Gen AI models with enterprise applications and workflows
• Lead technical design and mentor junior team members
• Work with stakeholders to identify and implement AI use cases
• Ensure scalability, security, and performance of AI solutions

Key Skills

• Deep understanding of LLM behavior & failure modes
• Prompt sensitivity, hallucination analysis, RAG failure modes
• Evaluation strategy ownership (offline & online)
• Tools: Ragas, DeepEval, TruLens
• Red-teaming & adversarial prompt design
• Vendor model comparison tracking
• Bridge between Data Science & Product