Staff + Senior Software Engineer

Who you are

• Significant software engineering experience, particularly with distributed systems
• Results-oriented, with a bias towards flexibility and impact
• Willingness to pick up slack, even if it goes outside your job description
• Desire to learn more about machine learning systems and infrastructure
• Thrive in environments where technical excellence directly drives both business results and research breakthroughs
• Care about the societal impacts of your work
• Experience with high-performance, large-scale distributed systems
• Experience implementing and deploying machine learning systems at scale
• Experience with load balancing, request routing, or traffic management systems
• Familiarity with LLM inference optimization, batching, and caching strategies
• Experience with Kubernetes and cloud infrastructure (AWS, GCP, Azure)
• Proficiency in Python or Rust
• We encourage you to apply even if you do not believe you meet every single qualification

What the job involves

• Our Inference team is responsible for building and scaling the critical systems that serve Claude to millions of users worldwide
• We bring Claude to life by serving our models via the industry’s largest compute-agnostic inference deployments
• We are responsible for the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators
• The team has a dual mandate: maximizing compute efficiency to reliably serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models
• We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms
• Inference systems are highly performance sensitive distributed systems
• Inference serves hundreds of thousands of customers every day, and the size & span of the inference fleet requires sophisticated routing, scaling, and networking systems
• Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide
• Develop resilient, flexible systems that adapt in real time to real world events
• Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators and multiple cloud providers
• Maximize compute efficiency and optimize cost across the fleet by autoscaling and orchestrating production, research, and experimental workloads across multiple cloud providers
• Build and operate production-grade deployment pipelines for releasing new models to users
• Provide high-performance inference infrastructure that enables researchers to develop next-generation models
• Integrate new AI accelerator platforms and support inference for new model architectures

Benefits

• Comprehensive health, dental, and vision insurance for you and your dependents
• Inclusive fertility benefits via Carrot Fertility
• 22 weeks of paid parental leave
• Flexible paid time off and absence policies
• Mental health support for you and your dependents
• Competitive salary and equity packages
• Optional equity donation matching at a 1:1 ratio, up to 25% of your equity grant
• Retirement plans with competitive matching
• Life and income protection plans
• $500/month flexible wellness and time saver stipend
• Commuter benefits
• Annual education stipend
• Home office stipends
• Relocation support for those moving for Anthropic
• Daily meals and snacks in the office