Research Engineer (Agent)

• Finetune new capabilities into Claude that maximize Claude’s performance or ease of use on agentic tasks
• Ideate, develop, and compare the performance of different tools for agents (eg memory, context compression, communication architectures for agents)
• Systematically discover and test prompt engineering best practices for agents
• Develop automated techniques for designing and evaluating agentic systems
• Assist with automated evaluation of Claude models and prompts across the training and product lifecycle
• Work with our product org to find solutions to our most vexing challenges applying agents to our products
• Help create and optimize data mixes for model training
• Help to create and maintain the infrastructure required for efficient prompt iteration and testing
• Implementing and testing a novel retrieval, tool use, sub-agent, or memory architecture for Claude
• Finetuning Claude to maximize its performance using a particular set of agent tools (eg a read-write memory, or an inter-agent communication system)
• Building the prompting and model orchestration for a production application backed by a language model
• Building and testing an automatic prompt optimizer or automatic LLM-driven evaluation system for judging a prompt’s performance on a task
• Building a scaled model evaluation framework driven by model-based evaluation techniques

Benefits

• Comprehensive health, dental, and vision insurance for you and your dependents
• Inclusive fertility benefits via Carrot Fertility
• 22 weeks of paid parental leave
• Flexible paid time off and absence policies
• Mental health support for you and your dependents
• Competitive salary and equity packages
• Optional equity donation matching at a 1:1 ratio, up to 25% of your equity grant
• Retirement plans with competitive matching
• Life and income protection plans
• $500/month flexible wellness and time saver stipend
• Commuter benefits
• Annual education stipend
• Home office stipends
• Relocation support for those moving for Anthropic
• Daily meals and snacks in the office- Have good communication skills and an interest in working with other researchers on difficult tasks
• Have a passion for making powerful technology safe and societally beneficial
• Have spent time prompting and/or building products with language models
• Stay up-to-date and informed by taking an active interest in emerging research and industry trends
• Enjoy pair programming (we love to pair!)
• Have 7+ years of ML and software engineering experience
• Have extensive prior experience exploring and testing language model behavior
• Have at least a high level familiarity with the architecture and operation of large language models
• Developing complex agentic systems using LLMs
• Large-scale RL on language models
• Multi-agent systems
• We require at least a Bachelor’s degree in a related field or equivalent experience
• We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed- Applications will be reviewed on a rolling basis
• Given that this is a nascent field, we ask that you share with us a project built on LLMs that showcases your skill at getting them to do complex tasks
• Here are some example projects of interest: design of complex agents, quantitative experiments with prompting, constructing model benchmarks, synthetic data generation, model finetuning, or application of LLMs to a complex task
• There is no preferred task; we just want to see what you can build
• It’s fine if several people worked on it; simply share what part of it was your contribution
• You can also include a short description of the process you used or any roadblocks you hit and how to deal with them, but this is not a requirement