AI Engineer | Agent Evals & Model Quality

AI Engineer | Agent Evals & Model Quality

Own how a production AI company decides whether its agents are good enough to ship.

I’m partnering with a technical, founder-led team hiring an AI Engineer to build the evaluation systems behind its platform.

You’ll own:

• Evaluation frameworks for multi-step agents and tool use.
• Golden datasets, benchmarks and regression suites.
• LLM judges, deterministic graders and human evaluation workflows.
• Model comparisons across quality, latency, reliability and cost.
• Feedback loops that turn production failures into better agents.

The team wants someone who has built production AI/ML systems, writes strong Python and can explain what they personally designed, shipped and improved.

Around 5+ years of software engineering experience is the guideline. Exceptional relevant ability and ownership matter more than a rigid experience threshold.

This should appeal if you want substantial technical responsibility and a direct say in how the product develops.

Message me with your resume and a brief example of an evaluation or production AI system you’ve owned.