ML Features Solutions Engineer

• We are seeking an ML Features Solutions Engineer to join our Product and Solution Engineering team, driving the development and optimization of core ML features for enterprise deployment
• This role combines deep ML expertise with hands-on engineering, working at the intersection of ML research and product development to deliver production-grade capabilities to our customers
• This role is critical for accelerating ML feature development and bridging the gap between ML research and product engineering and will be driving the following:
• Core ML Feature Development: You’ll drive improvements to ML features including model optimization, inference performance, and feature enhancements
• Production-Ready Solutions: Build and deploy production-ready ML solutions for enterprise customers with focus on reliability and scale
• Research to Product Bridge: Translate ML research innovations into practical product features and customer-facing capabilities
• Cross-Team Collaboration: Work closely with SDK, testing, and customer teams to ensure ML features meet enterprise requirements
• Impact: Accelerates ML feature development and optimization, enabling faster time-to-market for new capabilities while ensuring enterprise-grade quality and performance
• Design and implement core ML features including model optimization, quantization, and inference enhancements
• Optimize model performance for latency, throughput, and memory efficiency on SambaNova hardware
• Develop and improve features such as Function Calling, Structured Output, and JSON mode conformance
• Create end-to-end ML solutions that showcase platform capabilities and accelerate customer adoption
• Convert cutting-edge ML research into practical, deployable product features
• Establish benchmarks and quality standards for ML features in production environments
• Work with SDK team to ensure ML features are properly exposed and documented for developers
• Support enterprise customers implementing advanced ML features in their workflows
• Partner with ML research, platform engineering, and customer teams

Benefits

• Flexible PTO in US
• Parental Leave
• Benefits (medical, dental and vision)
• Flexible Spending Accounts
• 401k/Pensions
• Gym Access
• Flexible Working Hours- Track record of translating research concepts into production features
• Experience with model optimization techniques: quantization, pruning, distillation, efficient inference
• Expert proficiency in Python and deep learning frameworks: PyTorch (required), TensorFlow, or JAX
• Experience deploying ML models to production at scale
• 3+ years of hands-on experience with large language models and transformer architectures
• Master’s degree or higher in Computer Science, Machine Learning, Electrical Engineering, or related field
• 5+ years of industry experience in ML engineering or applied ML research
• Strong understanding of LLM inference optimization: KV cache, batching strategies, memory management
• PhD in Machine Learning, NLP, or related field
• Experience with custom hardware acceleration (TPUs, custom ASICs)
• Hands-on experience with inference frameworks: vLLM, TensorRT-LLM, or similar
• Experience with function calling and tool use in LLMs
• Knowledge of structured generation and constrained decoding
• Contributions to open-source ML projects
• Experience with ML feature development in enterprise contexts