C
CoreWeave
Software Engineer (Inference AI/ML)
Skills
PythonGolangMicroservicesPyTorchTensorFlowGrafanaMachine LearningAIPrometheusLinuxKubernetes
2 months ago
Share this opportunity
Share this opportunity to other talents of your network:
✓ Offer them a visibility boost with clients.
✓ Help your contacts find their next job.
Important information
Contract type:
Internship
Salary:
$92,000 – $135,000 / year
Location:
Sunnyvale, CA, USA
Work mode:
Onsite
Published on:
29 August 2026
What they need
- Join the Inference team to ship production features that improve latency, reliability, and cost for model serving on our GPU platform. As an IC1, you’ll implement well-scoped changes, learn our operational practices, and grow quickly with mentorship from experienced engineers
- Implement well-scoped features and fixes in Python/Go/C++ for model-serving services (e.g., Triton, vLLM, TensorRT-LLM, Ray Serve)
- Write tests, code comments, and short design docs; participate in code reviews
- Add basic metrics and dashboards; assist with alarms and runbooks
- Follow on-call runbooks and learn incident response in a guided rotation
- Contribute to performance experiments (e.g., request batching, concurrency, caching) with guidance- Foundations in data structures, algorithms, and networked services
- BS/MS in CS, EE, or related field, or equivalent practical experience
- Exposure to containers and Kubernetes (coursework or projects welcome)
- Experience with Python or Go (C++ a plus) and Linux fundamentals; Git/CI basics
- Curiosity about GPU inference concepts (micro-batching, KV cache, streaming)
- Coursework/research with PyTorch or TensorFlow; simple CUDA projects a plus
- Internship or project that deployed a microservice or ML inference demo
- Familiarity with Grafana/Prometheus/OpenTelemetry or similar tooling
Other offers great for you!
These companies are also looking for great profiles
S
Salutech
Ingénieur Logiciel IA
Freelance
Paris, France
Onsite, Hybrid
Skills
DockerPythonTesting & QAKubernetesSoftware refactoringCI/CDObservabilityAsynchronous programming
5 days ago
Quick apply
F
Fakto
AI Software Engineer
€70k–€90k
Permanent contract
Neuilly-sur-Seine, France
Hybrid
Skills
LLMs / Large language modelsBackend DevelopmentDevOpsAWSTerraform
8 hours ago
Quick apply
F
Fakto
AI Software Engineer
€70k–€90k
Permanent contract
Paris, France
Hybrid
Skills
LLMs / Large language modelsBackend DevelopmentDevOpsAWSTerraform
4 hours ago
Quick apply
No company information available.