Senior Machine Learning Engineer (DevOps/SRE)

• The Advertising Performance group focuses on performance for all participants in the Advertising ecosystem - Advertisers, Publishers, and Roku
• The systems and solutions span multiple disciplines and technologies to perform real-time multi-objective optimization across distributed systems at large scale and with low latency
• We use Machine Learning, Reinforcement Learning, AI, Control and Optimization Systems, and Auction Dynamics to solve a large set of complex problems
• At the core of this is our Machine Learning, Experimentation, and Inference Platform that powers the entire landscape, which we continuously evolve over time
• We are seeking a talented and experienced Senior Software Engineer, MLOps/DevOps, to join the Advertising Performance team and play a critical role in supporting and scaling our Machine Learning infrastructure
• You will partner closely with ML Scientists and Engineers to streamline the end-to-end ML lifecycle across training, evaluation, deployment, and monitoring — on top of a modern, cloud-native stack running on GCP and AWS using Kubernetes, Apache Airflow, Spark, Ray, MLflow, Chronon, etc
• Lead the design and operation of scalable, production-grade cloud infrastructure for ML workloads across AWS and GCP, including GPU/TPU-based training and inference environments
• Architect and improve CI/CD systems for ML models and platform services to enable fast, reliable, and safe production releases
• Own and evolve low-latency infrastructure for real-time model inference, including KV store and vector databases
• Define and enforce observability standards for ML systems, including model performance monitoring, drift detection, capacity planning, and pipeline health metrics
• Participate in on-call rotation, leading incident response and root-cause analysis for critical ML training and serving infrastructure
• Partner with data scientists and ML engineers to improve platform usability, accelerate model iteration, and implement strong MLOps and SRE best practices
• Champion operational excellence across ML infrastructure through automation, resilience engineering, disaster recovery planning, and continuous improvement

Benefits

• Medical, wellness and financial benefits

• Free snacks and access to the company fitness center

• Unlimited paid time off policy

• Work from home opportunities

• The ideal candidate has a strong background in DevOps/SRE practices, cloud infrastructure management, and MLOps tooling — with a passion for building platforms that accelerate ML experimentation and deployment at internet scale

• Strong infrastructure-as-code experience with Terraform or similar tooling

• Experience in the Advertising domain is a plus

• Excellent communication and cross-functional collaboration skills

• Strong programming skills in Python, and/or Scala, or Java for platform automation and tooling

• 8+ years of experience in DevOps, SRE, or ML infrastructure, including 4+ years supporting large-scale ML or AI systems

• Deep experience with Kubernetes and container orchestration on GCP (GKE) and/or AWS (EKS)

• Expertise with NoSQL or low-latency data stores such as Aerospike or similar technologies

• BS or MS in Computer Science, Engineering, or a related quantitative field

• Experience building and maintaining CI/CD systems using tools such as Jenkins or GitLab Runner

• Hands-on experience with data and orchestration technologies such as Apache Spark, Apache Flink, Apache Airflow, and Kafka

• Familiarity with feature engineering platforms such as Chronon and model lifecycle tools such as MLflow

• Experience with observability platforms such as Prometheus, Grafana, and Datadog