H
Hyperbolic
Member of Technical Staff (Inference)
Skills
AIKubernetes
1 month ago
Share this opportunity
Share this opportunity to other talents of your network:
✓ Offer them a visibility boost with clients.
✓ Help your contacts find their next job.
Important information
Contract type:
Permanent
Location:
San Francisco, CA, USA
Work mode:
Onsite
Published on:
30 September 2026
What they need
- We’re looking for an Inference Engineer to build inference capabilities on top of Forge, our unified control plane, so customers can consume model tokens without managing GPUs and our NeoCloud partners get a full-stack path to their own token-factory offering
- You’ll own how models get deployed and served across clusters distributed around the world, on heterogeneous hardware
- Deployment comes first: serving models on Forge and our Kubernetes offering, evaluating inference frameworks, and standing up the monitoring, gateways, and endpoints that make a deployment production-ready
- From there the work expands into optimization, autoscaling, KV-cache orchestration, and customer inference debugging
- This is the primary seat for inference at Hyperbolic \u2014 you’ll build it end to end, with real influence over where the scope lands- Working knowledge of NVIDIA Dynamo and how it fits into a distributed serving architecture
- Generalist instincts: you’re willing to pick up adjacent work when it’s what the product needs
- Proven ability to build a product end to end — you’ve taken something from nothing to serving real traffic
- Strong self-initiative and comfort operating as the primary owner of an area with minimal direction
- Experience setting up monitoring, gateways, and endpoints for production inference services
- Familiarity with modern inference frameworks and serving engines, and the judgment to evaluate and select among them for a given workload
- Deep Kubernetes experience, including hands-on ability to operate clusters in production, not just deploy to them
- Solid grasp of the concepts that govern inference performance: TTFT, disaggregated inference, speculative decoding, and KV cache and its inner workings
- Strong general inference background with a broad, high-level command of the stack rather than a narrow specialty — you can reason about the whole path from request to token
- Experience spanning both inference deployment and inference optimization
- Hands-on model optimization work — quantization, batching strategies, kernel-level tuning, or similar
- Understanding of RDMA and high-performance networking as they apply to distributed serving
- Experience deploying inference across heterogeneous accelerators
- Background supporting customers directly on inference debugging and performance issues
- Experience at a GPU cloud, inference provider, or AI infrastructure company
Other offers great for you!
These companies are also looking for great profiles
S
Salutech
Chef de projet Intégration DevOps & ML Engineer Cloud
500€/jour
Freelance
Paris, France
Onsite, Hybrid
Skills
PythonMachine LearningAWSKubernetesTerraformAzure
17 hours ago
Quick apply
L
LeHibou
Technical Infrastructure & Network Architect H/F
700
Freelance
Liège, Belgium
Hybrid, Onsite
Skills
Network ArchitectInfrastructure ArchitectLANWAN
12 hours ago
Quick apply
S
Salutech
Architecte Sécurité Cloud GCP
700
Freelance
Paris, France
Onsite, Hybrid
Skills
DevOpsKubernetesTerraformGoogle Cloud Platform (GCP)Cloud Security ArchitectureIdentity and Access Management (IAM)
11 hours ago
Quick apply