---
title: "DIAMOND | Diffusion World Model for RL | world-models.io"
canonical: "https://world-models.io/en/models/diamond/"
description: "DIAMOND is a diffusion-based world model for reinforcement learning that generates high-fidelity environment predictions."
author: "Tyler D."
generated: "2026-10-30"
---

New: the Timeline is live. Track world model releases, papers, and benchmark updates in real time.

The Knowledge Hub for AI World Models

# DIAMOND

DIAMOND uses diffusion models as world models for reinforcement learning, generating high-fidelity environment predictions for imagination-based policy learning.

robotics

model-based-rl

simulation

embodied-ai

## What is a world model?

A world model is an AI system that learns a predictive representation of how an environment changes over time. It can use observations, actions, or language to estimate future states and possible outcomes before an agent acts. World models support planning in model-based reinforcement learning, robotics, embodied AI, autonomous driving, and interactive simulation. This site catalogs these systems with model records, research papers, benchmark context, and source links. Start with the [world models database](https://world-models.io/en/world-models-database/), compare systems on the [leaderboard](https://world-models.io/en/leaderboard/), or read the [Performance Index methodology](https://world-models.io/en/methodology/performance-index/).

## Key Attributes

Static HTML snapshot of the model record for crawlers and no-JS readers.

| Attribute | Value |
| --- | --- |
| Model | DIAMOND |
| Lab / Organization | MSR |
| Category | Model-Based RL |
| Subtype | Diffusion World Model |
| World Model Type | Diffusion-based environment simulator |
| Primary Domain | Atari games |
| Architecture | Conditional diffusion model over observation sequences with action conditioning |
| Modality | Visual |
| Training Method | Diffusion model training on environment transitions + imagination-based policy optimization |
| Status | active |
| Year | 2024 |
| Performance Index | 64/100 (medium confidence, v1.1) |

## About DIAMOND

Main editorial body preserved directly in static HTML.

DIAMOND replaces traditional latent dynamics models with a diffusion model that directly generates future observations. By leveraging the expressiveness of diffusion models, DIAMOND produces highly detailed and accurate environment simulations. The agent trains entirely within these diffused imaginations, achieving state-of-the-art performance on Atari 100K while generating visually crisp world predictions.

DIAMOND is a diffusion-based environment simulator developed by Microsoft Research / University of Geneva in 2024 for atari games.

## Editorial Snapshot

Short extractable facts for answer engines and no-JS readers.

| Signal | Value |
| --- | --- |
| Definition | DIAMOND is a diffusion-based environment simulator developed by Microsoft Research / University of Geneva in 2024 for atari games. |
| Short Description | DIffusion As a Model Of the eNvironment in Deep RL: uses diffusion models as world models for reinforcement learning agents. |
| Benchmark Rows | 1 |
| FAQ Entries | 1 |
| Related Models | 2 |
| Related Guides | 1 |
| Related Research Topics | 3 |
| Last Updated | 2026-03-10 |

## Notable Features

Key capabilities associated with this model.

- • First diffusion-based world model for RL
- • Pixel-perfect imagination quality
- • State-of-the-art Atari 100K results
- • Replaces latent dynamics with diffusion

## Use Cases

Representative applications attached to this model record.

Atari games

Sample-efficient RL

High-fidelity world simulation

## Strengths and Limitations

Balanced assessment surfaced in static HTML.

### Strengths

- • Extremely high visual fidelity
- • Strong Atari 100K scores
- • Novel diffusion-based paradigm
- • No VQ-VAE tokenization needed

### Limitations

- • Slow diffusion inference
- • High compute cost
- • Not yet proven beyond Atari

## Benchmarks

Published benchmark evidence attached to this model record.

| Benchmark | Metric | Result | Source |
| --- | --- | --- | --- |
| Atari 100K | Mean HNS 1.56 x human | State-of-the-art | [Source](https://arxiv.org/abs/2405.12399) |

## References and Citations

Primary references preserved in static HTML for citation extraction.

| Reference | Link |
| --- | --- |
| Alonso et al., 2024. Diffusion for World Modeling: Visual Details Matter in Atari. NeurIPS 2024. | [Open source](https://arxiv.org/abs/2405.12399) |

## Related Models

Nearby models linked from the current editorial record.

| Model | Category | World Model Type | Index v1.1 |
| --- | --- | --- | --- |
| [DreamerV3](https://world-models.io/en/models/dreamer-v3/) | Model-Based RL | Imagination-based dynamics model | 88/100 |
| [IRIS](https://world-models.io/en/models/iris/) | Model-Based RL | Discrete token-based dynamics model | 65/100 |

## Direct Comparisons

Side-by-side comparisons already connected to this model.

| Comparison | Matchup | Summary |
| --- | --- | --- |
| [DreamerV3 vs DIAMOND](https://world-models.io/en/compare/dreamer-v3-vs-diamond/) | DreamerV3 vs DIAMOND | DreamerV3 and DIAMOND are both model-based RL agents that train policies via imagination, but they use fundamentally different dynamics models: RSSM latent dynamics vs. pixel-space diffusion models. |
| [OASIS vs GameNGen](https://world-models.io/en/compare/oasis-vs-gamengen/) | OASIS (Decart) vs GameNGen (Google Research) | OASIS and GameNGen both demonstrate neural networks functioning as real-time game engines, but they target different games and use different architectures. They represent the emerging frontier of neural game engines. |
| [IRIS vs DreamerV3](https://world-models.io/en/compare/iris-vs-dreamer-v3/) | IRIS vs DreamerV3 | IRIS and DreamerV3 are both leading model-based RL agents but use fundamentally different world model architectures: autoregressive token prediction vs. RSSM latent dynamics. |
| [OASIS vs DIAMOND](https://world-models.io/en/compare/oasis-vs-diamond/) | OASIS vs DIAMOND | Both use diffusion models as world models for interactive environments, but OASIS generates real-time playable Minecraft-like worlds while DIAMOND uses diffusion for model-based RL training in Atari. |
| [DreamerV3 vs IRIS](https://world-models.io/en/compare/dreamer-v3-vs-iris/) | DreamerV3 vs IRIS | Two model-based RL agents using fundamentally different world model architectures: DreamerV3's RSSM with actor-critic vs. IRIS's autoregressive Transformer with VQ-VAE tokens. |
| [GameNGen vs DIAMOND](https://world-models.io/en/compare/gamengen-vs-diamond/) | GameNGen vs DIAMOND | Both simulate game environments in real-time, but with radically different approaches: GameNGen uses a fine-tuned diffusion model for photorealistic DOOM simulation, while DIAMOND uses a diffusion-based world model for Atari with reinforcement learning. |
| [IRIS vs DIAMOND](https://world-models.io/en/compare/iris-vs-diamond/) | IRIS vs DIAMOND | Two approaches to learning game simulators: IRIS uses discrete tokenization with a GPT-like transformer, while DIAMOND leverages diffusion models for higher visual fidelity. |
| [OASIS vs Pandora](https://world-models.io/en/compare/oasis-vs-pandora/) | OASIS vs Pandora | Two real-time neural game engines: OASIS generates Minecraft-like worlds at 20+ FPS using latent diffusion, while Pandora creates diverse game worlds using a hybrid autoregressive-diffusion architecture. |

## Guides Referencing This Model

Crawler-readable guide links tied to this model.

| Guide | Summary |
| --- | --- |
| [Evaluating World Models: Benchmarks, Metrics and Pitfalls](https://world-models.io/en/guides/evaluating-world-models/) | A practical reference on how to benchmark world models: from sample efficiency on Atari 100K and DMControl to long-horizon prediction quality and downstream policy performance. |

## Research Topics Referencing This Model

Connected research areas surfaced directly in static HTML.

| Topic | Summary |
| --- | --- |
| [Video World Models](https://world-models.io/en/research/video-world-models/) | How video world models and video generation transformers learn physics, temporal consistency, and interactive simulation from large-scale video, from OpenAI Sora and Google DeepMind Genie to NVIDIA Cosmos and V-JEPA. |
| [Diffusion World Models](https://world-models.io/en/research/diffusion-world-models/) | How diffusion world models generate future states, preserve richer visual detail, and power video simulation systems such as DIAMOND, Sora, and Cosmos. |
| [World Model Evaluation](https://world-models.io/en/research/world-model-evaluation/) | How to evaluate world models across rollout quality, benchmark performance, planning utility, and downstream transfer instead of relying on visual plausibility alone. |

## Frequently Asked Questions

FAQ answers rendered directly into static HTML for extractable responses.

### Why use diffusion for world modeling?

Diffusion models generate higher-quality predictions than VAE or autoregressive approaches, producing pixel-perfect imaginations that enable better policy learning.

## Quick Answer

Short extractable summary preserved directly in static HTML.

- DIAMOND is a diffusion-based environment simulator developed by Microsoft Research / University of Geneva in 2024 for atari games.
- Use this page when you need a fast read on how DIAMOND fits into the model-based rl landscape, then validate the details in the benchmarks, citations, and related pages.
- A key strength surfaced in the editorial record is extremely high visual fidelity.

## Editorial Trust Signals

Editorial provenance and refresh policy preserved directly in static HTML.

**Published by** world-models.io editorial board.

**Lead editor** Tyler D. - Technical editor, methodology and benchmark analysis.

This model page synthesizes primary papers, official model pages, benchmark evidence, and related world-models.io context into a reference resource.

Each editorial page is assembled from primary sources, normalized into extractable summaries, checked for factual drift, and reviewed before publication or major refreshes. Last reviewed: 2026-03-10.

Pages are refreshed when a new paper, benchmark, release, architecture update, or stronger primary source materially changes the answer a reader or AI system should retrieve.

Each page links back to relevant primary sources and keeps a stable canonical URL so readers can verify claims, trace context, and reference the most up-to-date version. [See the editorial policy.](https://world-models.io/en/editorial-policy/)

Primary sources only

Last reviewed date visible

Methodology documented

Source links included

Correction channel published

Review date visible

## External Sources

Primary model and lab sources embedded in static HTML.

- [DIAMOND paper](https://arxiv.org/abs/2405.12399) Microsoft Research / University of Geneva primary research source
- [Microsoft Research official website](https://www.microsoft.com/en-us/research/) Related lab

## References

1. [[1] Alonso et al., 2024. Diffusion for World Modeling: Visual Details Matter in Atari. NeurIPS 2024.](https://arxiv.org/abs/2405.12399)