Research Engineer (Takeoff Intel)

• As a Research Engineer on Takeoff Intel you’ll build and run the evaluation and measurement instruments that make this research possible
• This is a generalist role on a small team: you’ll work across evals infrastructure, large-scale data processing, and analysis tooling, and you’ll prioritize shipping
• We build instruments that answer real questions and help set priorities, not dashboards that surface noise
• We value working prototypes, rapid iteration, accuracy and good prioritization. We often need to go from a vague research question to a running instrument quickly
• Design, build, and run capability evaluations and measurement instruments at scale
• Build the data and analysis pipelines that turn large volumes of model outputs and telemetry into reliable metrics
• Prototype new instruments fast, validate them, and decide what to keep
• Review and supervise AI-written code as a normal part of the workflow
• Work closely with research scientists on the team and with partner teams to define what’s worth measuring
• Contribute to internal write-ups and public reporting
• Some examples of our work:
• Anthropic ECI: our adaptation of Epoch Capabilities Index published in all recent system cards to measure capability acceleration
• AI R&D capability assessments in the Claude system cards
• When AI Builds Itself: all data in the article comes from our team

Benefits

• Comprehensive health, dental, and vision insurance for you and your dependents
• Inclusive fertility benefits via Carrot Fertility
• 22 weeks of paid parental leave
• Flexible paid time off and absence policies
• Mental health support for you and your dependents
• Competitive salary and equity packages
• Optional equity donation matching at a 1:1 ratio, up to 25% of your equity grant
• Retirement plans with competitive matching
• Life and income protection plans
• $500/month flexible wellness and time saver stipend
• Commuter benefits
• Annual education stipend
• Home office stipends
• Relocation support for those moving for Anthropic
• Daily meals and snacks in the office- We’re hiring at both junior and senior levels
• Communicate results clearly and collaborate closely with the researchers whose questions your instruments answer
• Prototype fast and are comfortable throwing code away
• Can work from a vague question rather than a spec
• Handle messy, large-volume data without over-engineering
• Have run experiments on large language models, not just moved their outputs around
• Have shipped an evaluation, data product, or research library end to end
• We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed
• Built evaluation harnesses or benchmark infrastructure for LLMs
• Experience with large-scale ML or data infrastructure (self-driving, observability, or similar) alongside ML exposure
• Built tools or libraries that other researchers rely on
• A track record of catching what AI-written code gets wrong