Research Scientist - World Modeling

About The Institute Of Foundation Models The Institute of Foundation Models (IFM) at MBZUAI is a research lab dedicated to meaningful foundation model research — building models from scratch, understanding them deeply, and publishing work that shapes the field. You’ll work alongside world-class researchers and engineers on problems that directly define the models we ship.

The Role Join the PAN world model project — our effort to build world models: foundation models that simulate, predict, and interact with the physical world. As a Research Scientist, you’ll drive the core research behind PAN — large-scale video generation, interactive and action-conditioned world models, and their applications in robotics and embodied AI — and publish at top venues while turning breakthroughs into working systems.

What You'll Do

• Conduct original research on video world models, video diffusion models, and action-conditioned generation — from idea to publication and deployment
• Design pre-training and post-training recipes for large-scale diffusion transformers, including scaling-law studies for video pre-training
• Advance world action models / video action models and their applications in robotics and embodied agents
• Develop rigorous evaluation benchmarks for physical accuracy, controllability, and interactivity
• Collaborate with engineering and data teams on large-scale training, data curation, and simulation-based data generation

What We're Looking For

• PhD in Machine Learning, Computer Science, Computer Vision, Robotics, or a related field, with first-author publications at top-tier venues (e.g., NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV, RSS, CoRL)

• Research experience with state-of-the-art video generative models and world models (e.g., Cosmos-3, LTX 2.3, Self-Forcing, Lingbot-World, or comparable systems)

• Deep expertise in at least one of the following areas:

• Full-stack data pipelines — large-scale video data pipelines and/or simulation data collection; annotation and filtering workflows for video / world model training

• Model training & infrastructure — training large-scale diffusion transformers on large GPU clusters

• Rendering engines & simulation — Unreal Engine and Blueprint-based gym environments, game-engine integration, building interactive simulated environments

• World action models & robotics — world action models / video action models, action-conditioned video generation, world-model applications in robotics

• Strong systems and engineering expertise in deep learning frameworks such as PyTorch

• Highly proficient with modern AI coding agents and web-based coding tools (e.g., Claude Code, Codex, Cursor), and skilled at leveraging them to dramatically accelerate research workflows

• Exceptional problem-solving skills and the ability to navigate ambiguity in rapidly evolving research areas

Nice To Have

• Experience accelerating diffusion model inference (distillation, few-step generation, real-time interactive generation)
• Experience with visual tokenization and multimodal foundation models
• Experience deploying world models in robotics or embodied-AI settings