Academic Researcher - AI Training and Evaluation (Remote)

About Pareto.AI

Pareto.AI is a human data platform connecting experienced professionals with leading AI researchers to help build safer, more reliable AI systems grounded in real-world expertise.

Project overview

This project focuses on improving the ability of advanced AI systems to reason over professional and academic documents. We are building an AI assistant capable of analyzing documents in your field, answering realistic professional or academic questions, and producing structured, expert-level responses reflective of real-world work.

Who are we looking for?

Researchers, academics, and graduate students tend to be especially well suited, since their day-to-day work already involves reading and synthesizing dense documents.

Practicing professionals or graduate students with demonstrated academic or professional experience in one of the following domains:

• Science & Academic fields — PhD researchers, postdocs, faculty, graduate teaching assistants, published researchers
• Healthcare — physicians, pharmacists, physician assistants, nurse practitioners, clinical researchers, allied health specialists, medical/clinical faculty
• Software Engineering — backend/full-stack/ML engineers, data scientists, DevOps and cloud engineers, CS graduate researchers
• Finance — financial analysts, applied mathematicians, accountants, actuaries, academic finance/economics/math instructors

Scope of work

Selected experts will design and evaluate realistic tasks reflecting professional workflows in their domain. Examples include:

• Assembling document sets from your field — published research literature, case studies, technical papers, filings — and posing realistic professional or academic questions to an AI assistant
• Working across long-document and multimodal formats (tables, charts, images, diagrams)
• Evaluating AI-generated responses for accuracy and completeness
• Grading model outputs and providing structured feedback

Minimum requirements

• Bachelor's degree or higher (or equivalent professional credential/license) in a relevant field
• Professional or academic experience applying that expertise to real documents or cases
• Ability to identify issues and risks in complex, domain-specific scenarios
• Strong written communication skills

Compensation and Commitment

• $50/hour for approved submissions
• Flexible, remote participation ( 10 hours/week )
• Initial work expected within the first week after acceptance
• Additional ad-hoc expert tasks may also be offered at the same rate.

Compliance Note

If you are applying from California, Washington, or New York , you MUST have an Established Business Entity (e.g., an LLC) for your application to be considered.

How to apply?

Apply with your LinkedIn profile. Qualified candidates will receive a follow-up link with further information.