Software Engineer (Enterprise Platform)

• As a Senior Enterprise Platform Engineer at Baseten, you’ll architect and lead development of infrastructure and platform features for our enterprise customers and cloud partners
• This includes enabling self-hosted and single tenant clusters, region-aware request routing, enterprise-grade data and security integrations, and more
• You’ll get to work on these types of projects as part of our Infrastructure team:
• Multi-cloud capacity management
• Inference on B200 GPUs
• Multi-node inference
• Fractional H100 GPUs for efficient model serving
• Architect and develop infrastructure and platform features tailored for enterprise customers, including self-hosted clusters, single-tenant environments, and cross-cloud workload orchestration
• Lead technical initiatives to productize secure and scalable private connectivity solutions
• Design and implement solutions addressing the complex regulatory and compliance requirements of our customers, including data residency, auditability, and enterprise data protection
• Advance our self-hosted infrastructure offerings, focusing on capacity management, release management, and observability tooling
• Collaborate on partner-focused initiatives to deliver secure, minimal Baseten deployments within partner environments
• Evaluate and implement emerging virtualization technologies to enhance platform isolation and security
• Independently develop technical specifications, collaborate cross-functionally to define product requirements, and drive projects from conception through execution
• Provide mentorship and leadership on enterprise infrastructure best practices, fostering knowledge-sharing across engineering teams

Benefits

• Remote-first work environment. The Baseten team is welcome to work from wherever they want; fully remote, in our San Francisco office, or a mix of both. Today, our team (including our founding team) is spread across the United States, Canada, and Armenia. We provide a $1,000 stipend for you to make your home-office comfortable and productive

• Regular in-person team summits. We get together as a team three times a year to plan, workshop, and most importantly, get to know each other better

• Unlimited PTO. We ask that everyone take at least 4 weeks of vacation. And we have a company-wide break between Christmas and New Year’s Day

• Full healthcare coverage. Medical, dental and vision insurance for you and your family

• Paid parental leave. 16-weeks fully paid parental leave (adoptive and non-birth parents included) and flexibility with schedules while returning to work

• Company-sponsored 401(k) for you to contribute to

• Learning and development budget. We encourage you to take classes, attend conferences, and invest in your craft and we’ll cover expenses to make it happen

• Bachelor’s degree or higher in Computer Science or related field

• Preferred experience working with AI/ML systems or familiarity with MLOps practices

• Excellent collaboration and communication skills, with experience coordinating across functional teams and directly with customers

• Advanced understanding of distributed systems concepts, cloud architectures, and performance optimization

• Demonstrated ability to independently manage technical projects, from planning and specification through implementation

• Past experience working with enterprise security, compliance, and privacy requirements

• 5+ years of experience building distributed systems, cloud infrastructure, or Kubernetes-based solutions in production environments