Unblinded
AI Evaluation Engineer
Skills
14 days ago
Share this opportunity
Share this opportunity to other talents of your network:
✓ Offer them a visibility boost with clients.
✓ Help your contacts find their next job.
Important information
Contract type:
Permanent
Salary:
$84,000 – $190,000 / year
Location:
Paramus, NJ 07652, USA
Work mode:
Onsite
Published on:
9 October 2026
What they need
Build trustworthy evaluations of AI answers, decisions and actions.
What you'll do:
Design benchmark cases, labels and rubrics for defined behaviors.
Separate development examples from held-out evaluation and prevent leakage.
Automate comparisons and investigate failure patterns and regressions.
Report evidence and limitations that support engineering release decisions.
Skills we're looking for:
Benchmark design, dataset separation, labeling/rubrics, statistical reasoning, automated evaluation and systematic error analysis.
Employment: Full-time.
Work arrangement: Hybrid, with 1-2 days per week in person in Paramus, New Jersey.
Salary: $84,000-$190,000 per year.
Benefits: 401(k), health insurance, dental insurance, vision insurance, and paid time off.
Pay: $84,000.00 - $190,000.00 per year
Benefits:
- 401(k)
- Dental insurance
- Health insurance
- Paid time off
- Vision insurance
Work Location: Hybrid remote in Paramus, NJ 07652
Other offers great for you!
These companies are also looking for great profiles
Espace Freelance
Audit Applicatif support & Intelligence artificielle
Freelance
Lille, France
Onsite, Hybrid
Skills
4 days ago
Quick apply
Tenth Revolution Group
Head of AI Platform / Product Lead IA (plateforme interne, GenAI en production)
Freelance
92400 Courbevoie, France
Hybrid
Skills
19 hours ago
Quick apply
Yunik
Lead Data Scientist Transverse – IA / Machine Learning / GenAI
Freelance
Paris, France
Hybrid
Skills
18 hours ago
Quick apply