LLM – Engineering Expert

Role Summary

Vraify is seeking an LLM – Engineering Expert to support advanced AI projects through high-quality preference data, rubric development, and scalable engineering workflows. This is a fully remote contract role for candidates based in the United States.

Key Responsibilities

• Develop and refine rubrics and quality criteria for preference data.
• Review and label data, identifying subtle quality issues.
• Build and maintain pipelines and infrastructure for data generation and collection.
• Summarize technical findings and collaborate with researchers and engineers to improve scalable workflows.

Requirements

• 5+ years of experience with Python, TypeScript, Go, or JavaScript.
• Experience building pipelines and infrastructure or navigating large codebases; VSCode experience is a plus.
• Hands-on experience with preference data collection or rubric creation.
• Strong technical judgment, clear written and verbal communication, and the ability to deliver in a fast-moving environment.

Engineering Domains

AI/LLM systems, data engineering, pipeline infrastructure, and preference data workflows.

Compensation & Contract

• Compensation: $500 per task.
• Contract duration: up to 24 weeks.

Work Schedule & Remote Setup

• 40 hours per week, with 4 hours of overlap with PST.
• Fully remote; candidates must be based in the United States.

Work Location: Remote