Data Scientist - AI Evaluator

Opportunity Overview

Handshake is looking for experienced data scientists to support AI research through flexible, part-time contract work. This is not a traditional job — you'll draw on your hands-on experience building and reasoning about models and statistical analysis to evaluate AI-generated content and provide feedback that helps AI reason like a practicing data scientist.

This is an ongoing, project-based opportunity you can take on alongside your current role.

What You'll Do

Use your domain expertise to create expert-level data science problems and scenarios grounded in real modeling, analysis, and experimentation work
Review and evaluate AI-generated responses for technical accuracy, practical feasibility, and alignment with how the work is actually done
Provide structured written feedback to help improve AI model performance
Complete tasks at your own pace with no set schedule or minimum hour requirement

Qualifications

Ideal candidates meet all three of the following:

Industry/research experience — minimum 1 year of professional experience at a top company, with direct hands-on work as a data scientist
Degree — Bachelor's degree in Data Science, Statistics, Mathematics, Computer Science, or a related field
Sub-domain depth — demonstrated expertise in one of the following areas:
Machine learning and applied ML
Statistical modeling and experimentation (A/B testing, causal inference)
Data analysis and feature engineering at scale

Additional qualifications (not required, but strengthen your application)

Experience at a recognized, top-tier tech company

Required for all applicants

Based in the United States
Strong written communication and attention to detail
Ability to explain complex data science concepts clearly
Ability to work independently in a remote, asynchronous environment

Pay: $120.00 per hour