Senior Deep Learning Software Engineer, Inference and Model Optimization

For our client, we are seeking a Senior Deep Learning Software Engineer, Inference and Model Optimization to join the team of a leader in the Telecommunications & Hardware space.

This role will focus on advancing deep learning inference capabilities for generative AI workloads, with an emphasis on large language models and diffusion models. You will work on optimizing model deployment, improving GPU performance, and enabling scalable software solutions that support high-throughput, low-latency AI applications. The position also partners closely with cross-functional engineering teams to integrate kernel-level innovations into a modular platform that strengthens model support and user experience.

Location: Remote - US based candidates only, no visa sponsorship available

Compensation: $184,000 – $356,500 annually

Responsibilities

• Train, develop, and deploy state-of-the-art generative AI models, including LLMs and diffusion models
• Leverage the torch 2.0 ecosystem to analyze and extract standardized model graph representations for automated deployment
• Develop high-performance optimization techniques for inference, including automated model sharding and efficient attention kernels
• Collaborate with cross-functional teams to integrate performant kernel implementations into the deployment solution
• Analyze and profile GPU kernel-level performance to identify optimization opportunities
• Continuously innovate on inference performance to maintain market leadership in inference software solutions
• Architect and design a modular and scalable software platform to enhance user experience and model support

Qualifications

• Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or a related field
• 8+ years of relevant work or research experience in Deep Learning
• Excellent software design skills, including debugging, performance analysis, and test design
• Strong proficiency in Python, PyTorch, and related ML tools, including Hugging Face
• Strong algorithms and programming fundamentals
• Good written and verbal communication skills, with the ability to work independently and collaboratively

Benefits

• Comprehensive benefits package including health, dental, and vision insurance
• Opportunities for professional development and growth
• Access to cutting-edge technology and resources
• Collaborative and innovative work environment
• Equity options available

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.