Senior/Staff Machine Learning Engineer

Who you are

• Experience working with distributed computing frameworks such as Flink, Spark, Ray for distributed data processing
• Experience building infrastructure for training data generation, dataset preparation, or ML feature pipelines
• Experience optimizing big data pipelines and infrastructure for cost efficiency
• Strong programming skills in Python and experience working with large-scale distributed workloads
• Experience with modern data infrastructure (data lakes, warehouses, orchestration systems, streaming platforms)
• Strong systems thinking, with the ability to reason about performance, scalability, reliability, and cost tradeoffs in distributed systems
• Proven ability to lead technical direction and influence architectural decisions across teams without formal authority

What the job involves

• We are seeking a senior data infra engineer to design and evolve the large-scale offline platform. This role focuses on building reliable infrastructure for generating data infrastructure, training datasets, and orchestrating data workflows. You will work closely with ML engineers and platform teams to ensure our pipelines can efficiently handle growing data volumes and increasingly complex training workloads
• You will play a key role in shaping how model datasets are prepared to ensure the reliability, scalability, and performance of our data platform
• Develop infrastructure that supports both batch and stream big data processing using technologies such as Flink, Spark, Ray, etc
• Design and operate large-scale data pipelines that generate training datasets used for machine learning training and experimentation
• Integrate data pipelines with workflow orchestration systems (e.g., Flyte, Airflow, or similar) to enable reliable multi-stage training workflows
• Improve reproducibility and observability of data pipelines through dataset validation, monitoring, and automated testing
• Optimize performance and resource utilization across distributed compute systems used for data processing
• Partner closely with ML engineers to enable efficient large-scale experimentation and model iteration
• Lead architectural improvements to ensure our offline data pipelines remain scalable, reliable, and cost-efficient

Benefits

• Comprehensive health, life and disability insurance
• Employee stock ownership
• Generous vacation and personal days
• Office food and free snacks, lots of health options!
• Employee Resource Groups
• Training and development programs
• Commute subsidy
• Competitive retirement/pension plans
• Paid leave for new parents
• Mental Health and Wellbeing programs and support
• Global Employee Assistance Program
• Volunteering and donation matching program