Staff Research Engineer (Model Efficiency)

• Large Language Models (LLMs) continue to push the boundaries of what AI systems can do — but inference is still the bottleneck
• The Model Efficiency team is responsible for pushing the limits of LLM inference efficiency across our foundation models. We explore and ship breakthroughs across the model execution stack, including:
• Model architecture and MoE routing optimization
• Decoding and inference-time algorithm improvements
• Software/hardware co-design for GPU acceleration
• Performance optimization without compromising model quality
• As a Staff Research Engineer, you will develop, prototype, and deploy techniques that materially improve how fast and efficiently our models run in production

Benefits

• Six weeks’ paid vacation
• Equity / stock options
• RRSP, 401(k), and Pension Scheme contributions
• Coverage for 100% of your insurance premiums across health, dental, vision, and travel
• Additional coverage for accessing mental health providers/services
• Six months of fully paid parental leave, including adoption and surrogacy
• Financial support for egg freezing and IVF in Canada and the UK
• A monthly fitness and wellness allowance
• Globally dispersed company that supports a remote work culture
• A $2,000 annual education benefit for professional development
• A weekly stipend for meals when working remotely and catered lunch when working from one of our global offices
• A monthly arts and culture allowance
• A monthly quality time allowance- Publications at top-tier conferences and venues (ICLR, ACL, NeurIPS)
• Passion to mentor others
• Strong software engineering skills
• Understand LLM architecture, and how to optimize LLM inference given resource constraints
• Have a PhD in Machine Learning or a related field
• Have significant experience with one or more techniques that enhance model efficiency
• An appetite to work in a fast-paced high-ambiguity start-up environment
• If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!