Product Manager (Inference Platform)

• Product at Baseten is a nascent function. Our company today has a strong engineering culture, is heavily customer-obsessed, and moves fast
• We’re building the product function now, and you’d be one of the people who defines it
• You’ll work directly with our founders and with some of the best systems and AI engineers and you’ll set the standard for what product looks like here
• PMs at Baseten don’t sit above engineers - you earn ownership by being technical, finding the truth in front of customers, building great cross-functional relationships, and just shipping great product experiences
• Once a model is deployed, keeping it fast, reliable, and economical at scale is where production inference is won or lost
• You’ll own the surface that makes that happen: how deployments autoscale, how traffic is routed, how the system fails over, and how workloads scale across clusters and regions
• You’ll own these as products end to end - both how they work under the hood and how customers configure and observe them - and you’ll help set and define the roadmap that infrastructure and product teams alike can build towards
• This space is largely still evolving - think Cloud Infrastructure in mid-2000s
• Your job is to make it 10x easier to reliably scale and serve AI models in production and set the market standard
• Autoscaling & placement — how deployments scale to demand (up under load, down to zero when idle) and where they land: one policy expressing region, compliance regime, and capacity preference, with compliance-bound workloads given right-of-way on sensitive capacity
• Routing, traffic & failover — every request reaches a healthy replica, rolling deploys never drop traffic, region-aware routing with multi-region / active-active and fallback as first-class policy, health-aware recovery
• The release engine beneath safe rollouts — the traffic-shifting that powers canary/shadow/A/B, warm-ups, drain, and probes
• Reliability as the metric — latency, throughput, uptime, and cost-efficiency at scale and a measurable decline in MTTR through self-serve incident management

Benefits

• Remote-first work environment. The Baseten team is welcome to work from wherever they want; fully remote, in our San Francisco office, or a mix of both. Today, our team (including our founding team) is spread across the United States, Canada, and Armenia. We provide a $1,000 stipend for you to make your home-office comfortable and productive

• Regular in-person team summits. We get together as a team three times a year to plan, workshop, and most importantly, get to know each other better

• Unlimited PTO. We ask that everyone take at least 4 weeks of vacation. And we have a company-wide break between Christmas and New Year’s Day

• Full healthcare coverage. Medical, dental and vision insurance for you and your family

• Paid parental leave. 16-weeks fully paid parental leave (adoptive and non-birth parents included) and flexibility with schedules while returning to work

• Company-sponsored 401(k) for you to contribute to

• Learning and development budget. We encourage you to take classes, attend conferences, and invest in your craft and we’ll cover expenses to make it happen

• You reason fluently about scaling, routing, failover, and the cost/performance frontier — and you earn the respect of staff engineers doing it

• You’ve owned capabilities end to end, backend through UX, rather than a single slice

• 8+ years in product management, including deep experience with infrastructure, distributed systems, or ML serving

• You drive cross-team roadmaps and the dependencies beneath them, and you’re at your best defining a category that doesn’t fully exist yet

• Hands-on with GPU infrastructure, Kubernetes, or serving frameworks like vLLM, TensorRT-LLM, or SGLang