Maths Expert

Role & responsibilities

• Design and solve challenging mathematics problems that test the capabilities and limitations of large language models.
• Create clear, accurate, high-quality step-by-step solutions with detailed reasoning.
• Develop gold-standard mathematical data for AI model training and evaluation.
• Work with LLM researchers to align task designs with evaluation goals.
• Target areas where AI models struggle, including symbolic manipulation, abstraction, and multi-step reasoning.
• Help define and build evaluation benchmarks covering mathematics from advanced undergraduate through graduate and PhD-level concepts.
• Construct novel mathematical scenarios and evaluate complex reasoning pathways.

Preferred candidate profile

• PhD in Mathematics or an equivalent technical field.
• Strong foundation in Mathematics spanning advanced engineering entrance-level through graduate and PhD-level concepts.
• Strong analytical, research, mathematical reasoning, and problem-solving skills.
• Ability to break down complex mathematical concepts into clear, structured, step-by-step reasoning.
• Strong lateral and creative thinking skills for constructing novel mathematical scenarios.
• Excellent English comprehension and structured written communication.
• Ability to provide constructive feedback and detailed annotations.
• Self-motivated and comfortable working independently in a fast-paced, remote-first environment.
• Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required.