Mechanical Engineer - AI Evaluation

We’re seeking Mechanical Engineers for paid [$55-75 / hour] remote contract work. The work is project-based, fully asynchronous, and scoped to your professional expertise.

About Ambitus

Ambitus is an applied AI product and research company that partners with domain experts and enterprises to advance frontier AI capabilities.

About the role

We are working to build the future of AI by pushing the boundaries of what frontier models can achieve. The focus of this role will be reading real mechanical engineering documents that we provide, working out the questions an engineer would need to answer from them, and judging whether AI models get those answers right.

Responsibilities

• Read equipment manuals, specifications, test reports, and technical reports, and work out the questions an engineer would face, such as checking a specification's requirements against its test procedure.
• Write challenging questions that can only be answered by combining information from several parts of a document, along with the correct answer and a checklist for grading responses.
• Review answers written by AI models and other experts, flag anything that is wrong, missing, or unsupported by the document, and write clear feedback on how it should change.
• Judge whether each task reflects how these documents are used in real engineering work, keeping your judgments consistent across reviews.

Qualifications

• Bachelor's degree in mechanical engineering or a closely related field.
• At least 3 years of professional engineering experience in design, test, manufacturing, or maintenance.

Required Skills

• Be experienced working from specifications, engineering drawings, tolerances, and technical manuals.
• Have exceptional attention to detail and be comfortable applying the same standard across reviews.
• Possess English communication skills, with a focus on written proficiency.
• A PE license, or test, reliability, or aerospace experience, is a plus but not required.

Application process

Apply on our site: https://platform.ambitus.ai/jobs/job-opening-b03e718d

The hiring team reviews resumes and reaches out to shortlisted candidates with next steps.