AI Quality Assurance Intern

• We are seeking curious, detail-oriented students to join our AI Delivery team as AI Quality Assurance Interns
• This is a hands-on role where you will evaluate the behavior, accuracy, and reliability of Cresta’s AI Agents and Agent Assist systems
• Unlike traditional QA, this work sits at the intersection of:
• AI behavior analysis
• Intent recognition evaluation
• Conversation quality assessment
• Model output auditing
• Light prompt testing and refinement
• You will help ensure our AI systems act as intended, follow correct business logic, and provide accurate and safe outputs to end users
• As an AI Quality Assurance Intern, you will:
• Execute structured test plans for AI Agent implementations
• Validate that intents, entities, and workflows trigger correctly
• Identify behavioral inconsistencies, misclassifications, or hallucinations
• Review and validate AI-generated suggestions, summaries, and classifications
• Provide actionable feedback to improve intent models and redaction/PII handling
• Run bias, redaction, and transcription accuracy checks
• Spot patterns or emerging issues across test sets
• Contribute ideas for improving internal QA processes and tools

Benefits

• Weekly lunch & learn
• Work with an A+ team of ex-Founders, world leading scientists, and nationally competitive athletes
• Mentorship - A world class mentorship board advises and mentors our team-members to capture the opportunity ahead of us- AI/ML, NLP, or chatbots
• Product quality and user experience
• This is an excellent fit for students interested in:
• Exploring a career in AI evaluation, AI ops, or product QA
• Linguistics, conversation analysis, or human–AI interaction
• No advanced ML experience is required — just strong analytical thinking and curiosity about how intelligent systems behave