Senior Staff Machine Learning Engineer (Perception)

• Our Perception team is responsible for using our sensor data to understand the complex and dynamic environments where we drive
• In this role, you will have access to the best sensor data in the world and an incredible infrastructure for testing and validating your algorithms
• We are creating new algorithms for segmentation, tracking, classification, and high-level scene understanding, and you could work on any (or all!) of these components
• As a Principal ML Engineer, you will lead the development of machine learning algorithms that can range in influence from onboard autonomy to offboard autonomy and validation
• You will collaborate closely with other teams specializing in Prediction, Planning, Simulation, and Safety Validation, influencing our overall technical stack
• Your role will look at problems in a way that crosses team boundaries to prototype new approaches that influence the long term technical direction of multiple organizations within the company
• The impact of the role can be in the form of impacting immediate company milestones to leading forward-looking exploratory projects
• Develop new algorithms to understand the scene around the robot, and how that scene would evolve through time
• Build multi-modal foundation models for on-vehicle and offline applications
• Develop new algorithms to apply generative AI to simulation to improve the realism of our offline validation systems
• Leverage our large-scale machine learning infrastructure to discover new solutions and push the boundaries of the field
• Provide technical mentorship to the broader group of ML developers at Zoox
• Collaborate with engineers on Prediction, Planning, and Simulation to solve the overall Autonomous Driving problem in complex urban environments

Benefits

• Paid parental leave
• Affinity groups and sports clubs
• Work from home opportunities
• Health insurance
• Our crew’s health and happiness is our first priority. We offer comprehensive health and mental health support, a wellbeing program, and unlimited and flexible paid time away
• We invest in our crew—and their families—for the long term. That includes generous family planning support, caregiver support, and strong cash compensation with great equity upside
• We look after our crew when they’re in the office too. Our famous food program is a great example, featuring a daily changing menu of local and sustainable dishes
• There’s a busy calendar of social events at Zoox, with more sports teams than you can count. And, of course, playing with robots is an important part of the job description- BS, MS, or PhD degree in computer science or related field
• Fluency in C++ or Fluency in Python with a basic understanding of C++
• Experience with modern computer vision techniques
• Strong mathematical skills and understanding of probabilistic techniques
• Extensive experience with programming and algorithm design-Strong mathematics skills
• Experience with training and deploying Deep Learning models on sensor data-Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines
• Publications in your field (CVPR, ICCV, RSS, ICRA preferred)
• Experience with realtime sensor fusion (e.g. LiDAR, camera, radar)
• Experience with autonomous robots
• Experience with 3D data and representations (pointclouds, meshes, etc.)
• Experience with novel pipelines and architectures for convolutional neural nets