Data Science Analyst (Remote)

• Role: Data Science Analyst (Remote)
• Location: Remote (Work from Anywhere)
• Job Type: Contract
• Payout: $120- $170/hr

Role Overview:

We are hiring for one of our clients, seeking a Data Science Expert to evaluate how well AI systems perform real-world data science work. The role involves defining grading criteria and scoring completed work samples with detailed written justifications. Candidates will assess analyses, models, dashboards, and written recommendations without producing deliverables themselves.

Key Responsibilities:

• Design precise, task-specific grading criteria for real-world data science deliverables including analyses, models, dashboards, experiment readouts, and written recommendations.

• Score AI-generated and human work samples against established criteria with detailed written justifications for each score.

• Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.

• Incorporate structured feedback from senior reviewers and iterate quickly on grading criteria and evaluations.

• Maintain high attention to detail while managing multiple evaluations with calibrated peer reviews.

Required Skills & Qualifications:

• Background in business operations, product, or growth data science at top-tier technology companies.

• Deep fluency in experiment design and A/B testing, metric definition, SQL, Python analysis, and communicating findings to executive stakeholders.

• Exceptionally strong written communication skills for crafting precise, evidence-based evaluations.

• Detail-oriented mindset with comfort in having judgment reviewed and calibrated against peers.

More About the Opportunity:

This role offers a unique opportunity to work with a leading AI research organization, contributing to the evaluation of AI systems in real-world data science applications. The project focuses on defining excellence in data science deliverables and improving AI performance through rigorous assessment.

Equal Opportunity Employer:

We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.

Apply Now!