--- title: "Video Generation World Model Transformers: Sora, Genie, Cosmos." canonical: "https://world-models.io/en/research/video-world-models/" description: "A 2026 guide to video generation world models and Transformers: OpenAI Sora, Google DeepMind Genie, NVIDIA Cosmos, V-JEPA, physical consistency." author: "Tyler D." generated: "2026-10-30" --- New: the Timeline is live. Track world model releases, papers, and benchmark updates in real time. The Knowledge Hub for AI World Models # Video World Models How video world models and video generation transformers learn physics, temporal consistency, and interactive simulation from large-scale video, from OpenAI Sora and Google DeepMind Genie to NVIDIA Cosmos and V-JEPA. robotics model-based-rl simulation embodied-ai ## What is a world model? A world model is an AI system that learns a predictive representation of how an environment changes over time. It can use observations, actions, or language to estimate future states and possible outcomes before an agent acts. World models support planning in model-based reinforcement learning, robotics, embodied AI, autonomous driving, and interactive simulation. This site catalogs these systems with model records, research papers, benchmark context, and source links. Start with the [world models database](https://world-models.io/en/world-models-database/), compare systems on the [leaderboard](https://world-models.io/en/leaderboard/), or read the [Performance Index methodology](https://world-models.io/en/methodology/performance-index/). ## Research Snapshot Static research summary generated from local editorial content. | Attribute | Value | | --- | --- | | Topic | Video World Models | | Summary | How video world models and video generation transformers learn physics, temporal consistency, and interactive simulation from large-scale video, from OpenAI Sora and Google DeepMind Genie to NVIDIA Cosmos and V-JEPA. | | Related Models | 9 | | Citations | 3 | ## What Are Video World Models? Editorial body section preserved directly in static HTML. Video world models learn environment dynamics directly from video sequences, treating video as a rich source of temporal, spatial, and physical structure. Instead of only modeling rewards or compact control states, they model how scenes evolve over time and how actions or prompts alter those futures. ## Why Video Has Become a Core World Modeling Modality Editorial body section preserved directly in static HTML. Video captures object permanence, motion, occlusion, contact, and scene continuity at internet scale. That makes it one of the most information-dense training signals available for world models. As a result, video-based systems are increasingly central to robotics simulation, autonomous driving, embodied AI, and interactive environment generation. ## Main Approaches: Generative, Predictive, and Interactive Editorial body section preserved directly in static HTML. The field now spans diffusion-based video generation, autoregressive Transformer and token models, JEPA-style predictive latent models, and action-conditioned interactive simulators. OpenAI Sora and NVIDIA Cosmos emphasize generative realism, Google DeepMind's Genie systems emphasize playable environments, and V-JEPA emphasizes predictive abstraction rather than pixel synthesis. ## Where Video World Models Are Strongest Today Editorial body section preserved directly in static HTML. Video world models are strongest when they need to produce realistic future frames, model plausible physical events, and create large quantities of synthetic training data. They are especially useful in driving simulation, environment generation, and embodied pretraining, where realism and temporal continuity matter. ## Open Problems in Video World Modeling Editorial body section preserved directly in static HTML. The biggest open problems are long-horizon coherence, stable memory, action grounding, and evaluation. A model can generate visually plausible clips while still failing at causal control, object permanence, or physical consistency over longer interactions. ## Related Models | Model | Lab | Category | Index v1.1 | | --- | --- | --- | --- | | [Sora](https://world-models.io/en/models/sora/) | OpenAI | Generative World Model | 63/100 | | [Genie 2](https://world-models.io/en/models/genie-2/) | Google DeepMind | Generative World Model | 79/100 | | [Genie 3](https://world-models.io/en/models/genie-3/) | Google DeepMind | Generative World Model | 89/100 | | [NVIDIA Cosmos](https://world-models.io/en/models/nvidia-cosmos/) | NVIDIA | Foundation World Model | 87/100 | | [V-JEPA](https://world-models.io/en/models/v-jepa/) | Meta | Self-Supervised World Model | 70/100 | | [V-JEPA 2](https://world-models.io/en/models/v-jepa-2/) | Meta | Self-Supervised World Model | 87/100 | | [UniSim](https://world-models.io/en/models/unisim/) | Google DeepMind | Generative World Model | 72/100 | | [DIAMOND](https://world-models.io/en/models/diamond/) | Microsoft Research / University of Geneva | Model-Based RL | 64/100 | | [Pandora](https://world-models.io/en/models/pandora/) | Tsinghua University / ByteDance | Generative World Model | 52/100 | ## Frequently Asked Questions FAQ answers rendered directly into static HTML for extractable responses. ### Are video generation models the same as video world models? Not always. A video generator can produce plausible sequences without being a strong interactive world model. Video world models become more useful when they preserve causality, memory, and controllability over future states. ### Which systems define the video world model frontier? Sora, Genie 3, NVIDIA Cosmos, V-JEPA 2, and UniSim each represent different parts of the frontier, from generative realism to predictive abstraction and interactive simulation. ## Quick Answer Short extractable summary preserved directly in static HTML. - Video World Models explains the core definition, methods, and systems involved in this research area. - This topic highlights the main trade-offs, open challenges, and practical implications for world models. - Related models and references connect the concept to concrete systems and primary sources. ## Editorial Trust Signals Editorial provenance and refresh policy preserved directly in static HTML. **Published by** world-models.io editorial board. **Lead editor** Bernard Grenat. This research page curates topic explanations, linked models, and citations grounded in primary research sources. Each editorial page is assembled from primary sources, normalized into extractable summaries, checked for factual drift, and reviewed before publication or major refreshes. Last reviewed: 2026-09-27. Pages are refreshed when a new paper, benchmark, release, architecture update, or stronger primary source materially changes the answer a reader or AI system should retrieve. Each page links back to relevant primary sources and keeps a stable canonical URL so readers can verify claims, trace context, and reference the most up-to-date version. [See the editorial policy.](https://world-models.io/en/editorial-policy/) Primary sources only Last reviewed date visible Methodology documented Source links included Correction channel published Review date visible ## External Sources Primary research citations embedded in static HTML. - [Video World Models reference](https://openai.com/index/video-generation-models-as-world-simulators/) Brooks et al., 2024. Video Generation Models as World Simulators. - [Video World Models reference](https://arxiv.org/abs/2404.08471) Bardes et al., 2024. V-JEPA: Video Joint Embedding Predictive Architecture. - [Video World Models reference](https://arxiv.org/abs/1803.10122) Google DeepMind, 2025. Genie 3: A New Frontier for World Models. ## References 1. [[1] Brooks et al., 2024. Video Generation Models as World Simulators.](https://openai.com/index/video-generation-models-as-world-simulators/) 2. [[2] Bardes et al., 2024. V-JEPA: Video Joint Embedding Predictive Architecture.](https://arxiv.org/abs/2404.08471) 3. [[3] Google DeepMind, 2025. Genie 3: A New Frontier for World Models.](https://arxiv.org/abs/1803.10122)