LLM Evaluation Lead (Applied Scientist)

Job highlights

• Senior Generative AI Engineer with expertise in LLM behavior, prompt engineering, RAG pipelines, and adversarial prompt design
• Design and develop Generative AI and LLM solutions, implement RAG pipelines and AI agents, integrate AI models with enterprise workflows, lead technical design and mentor team, ensure scalability and security

Job Summary

We are looking for a Senior Generative AI Engineer with strong hands-on experience in AI/ML and LLM technologies. The role requires excellent communication, leadership skills, and deep coding expertise to build and deploy enterprise Gen AI solutions.

Key Responsibilities

• Design and develop Generative AI and LLM-based solutions
• Implement RAG pipelines, AI agents, prompt engineering, and knowledge systems
• Integrate Gen AI models with enterprise applications and workflows
• Lead technical design and mentor junior team members
• Work with stakeholders to identify and implement AI use cases
• Ensure scalability, security, and performance of AI solutions

Key Skills

• Deep understanding of LLM behavior & failure modes
• Prompt sensitivity, hallucination analysis, RAG failure modes
• Evaluation strategy ownership (offline & online)
• Tools: Ragas, DeepEval, TruLens
• Red-teaming & adversarial prompt design
• Vendor model comparison tracking
• Bridge between Data Science & Product