Senior Software Engineer (Inference)

• We’re hiring a Software Engineer to help turn cutting-edge AI research into products our customers rely on every day. You’ll sit on a fast-paced engineering team between our research org and our Applied teams, taking new model capabilities from proof of concept to robust, well-documented APIs serving production traffic at scale
• Design and ship customer-facing APIs that expose new model capabilities, owning them from prototype through launch and ongoing iteration
• Scale inference infrastructure to support our 1M+ api users
• Partner with researchers to productionize new techniques. For example, turning a notebook or POC into something with the latency, reliability, and ergonomics customers expect
• Work with our customers and Applied teams to understand how users are building with our products, and feed that back into product design and research direction
• Contribute across the stack as needed: backend services, inference infrastructure, SDKs, internal tooling

Benefits

• Home office stipend: We invest in our people first and offer competitive salaries across all roles andEvery new team member gets U$1,000 to improve their home office. We want to make sure everyone has the setup to do their best work. locations
• Equity: We want our team members to have skin in the game and an opportunity to see long-term returns on the hard work they are putting in. To that end, every team member receives a generous equity grant
• Premium benefit offerings: We offer premium medical, dental, and vision plans and cover up to 100% of the premiums for both the employee and their family. We also offer opportunities to contribute to an HSA or FSA, short-term and long-term disability coverage, and life insurance
• Unlimited PTO: We offer a flexible PTO policy to all team members and encourage everyone to take time off to recharge, do something fun, and spend time with loved ones
• Team offsites: We have team and company-wide retreats in amazing locations to give everyone an opportunity to meet in person, collaborate, and build working relationships that make us a better team
• Global remote team: We hire the best person for the job, regardless of location. Our remote-first culture allows team members to make an impact from anywhere in the world
• Diversity and inclusion: We celebrate diversity and are committed to creating an inclusive environment for all employees. We are proud to be an equal-opportunity workplace
• Flexible schedule: Strong teams are built on mutual trust and accountability. We believe in giving our team members ownership over their work and a flexible schedule to allow them to operate at their highest potential- Genuine curiosity about AI/ML. You don’t need to be a researcher, but you should want to understand what the models are doing well enough to make good engineering decisions around them
• Strong backend engineering experience, including building and supporting machine learning infrastructure and/or customer-facing APIs in production
• Comfort operating with ambiguity. Research timelines and product timelines don’t always line up, and you’re energized rather than frustrated by that
• Strong collaboration skills. You’ll be working daily with researchers, applied engineers, and sometimes customers, people with very different contexts and priorities, and the role only works if you enjoy that