AI Agent Evaluations Intern

Who you are

• Currently enrolled in a MBA
• Have built with or used AI tools such as LLM APIs, chat assistants, or agents, and can explain how they work and where they fail
• Write clearly and briefly
• Comfortable talking with startup founders and product leaders. Able to hold your view when someone pushes back, and to change it when the facts say so
• Able to make progress on problems that have no set process yet
• Based in the San Francisco Bay Area
• Available 10 to 15 hours a week during the school year
• The internship starts October or November 2026
• You have built an AI agent, an evaluation, or a benchmark, even as a class or side project
• You have worked at or with a B2B software company in any role: startup, venture, sales, or product
• You have worked in customer support, sales, or marketing (the jobs the agents we evaluate are built to do)
• You have written about AI or software for a public audience (blog, newsletter, research)
• You already know the AI startup scene in San Francisco

What the job involves

• G2 evaluates AI agents on real tasks and publishes the results as leaderboards on g2.ai. This intern role helps the Agentic Marketplace team grow that program: supporting the evaluation method, working with AI agent vendors, tracking other evaluators, and monitoring market trends. Reports to the Head of Product, Agentic Marketplace. Works with product, data science, and engineering
• Responsibility Area: Evaluation method (about 50% of time)
• Break an AI agent's job (for example, outbound sales) into steps that can be tested. Write the tasks, test data, and scoring rules for those steps
• Review the scores our AI judge and human reviewers give
• Responsibility Area: Vendor relationships (about 25% of time)
• Support scaling system to engage with hundreds of vendors
• Prepare the results packet we share with each vendor before we publish, and keep the vendor pipeline current every week
• Responsibility Area: Market landscape (about 25% of time)
• Track who else evaluates AI agents (AI labs, benchmark groups, evaluation startups, analyst firms) and what they publish

Benefits

• 22 days holiday (excl. bank holidays)
• Work from home opportunities