---
title: "World Models & Reinforcement Learning | world-models.io"
canonical: "https://world-models.io/en/world-models-reinforcement-learning/"
description: "How world models transform reinforcement learning through imagination, planning, and sample-efficient learning."
author: "Tyler D."
generated: "2026-10-30"
---

New: the Timeline is live. Track world model releases, papers, and benchmark updates in real time.

The Knowledge Hub for AI World Models

# World Models & Reinforcement Learning

The intersection of world models and reinforcement learning, where learned environment models enable agents to plan and learn from imagined experience.

robotics

model-based-rl

simulation

embodied-ai

## What is a world model?

A world model is an AI system that learns a predictive representation of how an environment changes over time. It can use observations, actions, or language to estimate future states and possible outcomes before an agent acts. World models support planning in model-based reinforcement learning, robotics, embodied AI, autonomous driving, and interactive simulation. This site catalogs these systems with model records, research papers, benchmark context, and source links. Start with the [world models database](https://world-models.io/en/world-models-database/), compare systems on the [leaderboard](https://world-models.io/en/leaderboard/), or read the [Performance Index methodology](https://world-models.io/en/methodology/performance-index/).

## How to use this evidence

A practical interpretation framework for readers comparing fast-moving world-model research.

**Scope.** World Models & Reinforcement Learning is evaluated as a focused research and discovery surface, not as a claim that every listed system is directly comparable. Architecture, task, observation modality, action conditioning, training data, and evaluation protocol determine which comparisons are meaningful.

**Evidence method.** Prefer original papers, official technical reports, project pages, and versioned benchmark protocols. A reported score is retained with its source and context; it should only influence a ranking when the task, metric, unit, split, and protocol are compatible.

**Limitations.** World-model terminology changes across reinforcement learning, video generation, robotics, autonomous driving, and embodied AI. Use the linked model and methodology pages to check freshness, reproducibility, availability, and domain fit before treating an editorial summary as a deployment recommendation.

## External Sources

Primary references and official sources surfaced directly in static HTML for crawlers and no-JS readers.

- [Dyna (1991)](https://dblp.org/rec/journals/sigart/Sutton91) Historical starting point
- [MuZero paper](https://arxiv.org/abs/1911.08265) Planning with learned models
- [DreamerV3 paper](https://arxiv.org/abs/2301.04104) Modern model-based RL

## References

1. [1] Sutton, 1991. Dyna.
2. [[2] Hafner et al., 2023. DreamerV3.](https://arxiv.org/abs/2301.04104)
3. [[3] Schrittwieser et al., 2020. MuZero.](https://arxiv.org/abs/1911.08265)