Frontend Code Evaluator - Expert

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Frontend Engineer — Web Replication Preference Rater

Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities

• Render a reference page and two candidate replications side by side at desktop width. Judge which is the closer reproduction.
• Diff layout fidelity in detail, including box model, typography, color, image handling, and overflow.
• Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct.
• Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid.
• Write structured rationales for every judgment, ranking defects by importance in precise language.
• Flag ties, ambiguous cases, and broken task items rather than forcing a preference.

Qualifications Must-Have

• 3+ years of professional web development experience, primarily in frontend or full-stack work.
• Fluency in hand-written HTML and CSS.
• Working command of browser devtools.
• Enough JavaScript to read scripts and understand DOM manipulation.
• Comfort in a terminal for local server setup.
• Strong written English and discipline to justify judgments.

Preferred

• Prior RLHF, preference labeling, or model evaluation work.
• Code review or technical assessment background.
• Pixel-perfect design-to-code experience.
• Web accessibility expertise (WCAG, ARIA).
• Familiarity with LLMs' typical failures in codegen.
• Web scraping or DOM parsing experience.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: [email protected]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.