New: the Timeline is live. Track world model releases, papers, and benchmark updates in real time.
world-models.io
The Knowledge Hub for AI World Models

Imagination-Augmented Agents (I2A)

I2A agents use learned environment models to imagine possible futures, extracting useful information from imagined trajectories to improve policy decisions.

robotics model-based-rl simulation embodied-ai

Key Attributes

Static HTML snapshot of the model record for crawlers and no-JS readers.

AttributeValue
ModelImagination-Augmented Agents (I2A)
Lab / OrganizationDeepMind
CategoryModel-Based RL
SubtypeImagination-Augmented Policy
World Model TypeImagination-augmented model-free agent
Primary DomainAtari / Planning
ArchitectureModel-free policy augmented with rollout encoder over imagined trajectories
ModalityVisual
Training MethodJoint training of environment model and imagination-augmented policy network
Statusfoundational
Year2017
Performance Index45/100 (medium confidence, v1.1)

About Imagination-Augmented Agents (I2A)

Main editorial body preserved directly in static HTML.

Imagination-Augmented Agents (I2A) combine model-free reinforcement learning with learned world models. The agent uses an environment model to generate imagined rollouts of possible futures, then aggregates these imagined trajectories as additional context for its policy. This allows the agent to benefit from planning-like behavior without fully committing to model-based control. I2A demonstrated that even imperfect learned models could improve policy quality when used as an augmentation rather than the sole basis for decision-making.

Imagination-Augmented Agents (I2A) is an imagination-augmented model-free agent developed by Google DeepMind in 2017 for atari / planning.

Editorial Snapshot

Short extractable facts for answer engines and no-JS readers.

SignalValue
DefinitionImagination-Augmented Agents (I2A) is an imagination-augmented model-free agent developed by Google DeepMind in 2017 for atari / planning.
Short DescriptionAn agent architecture that augments model-free policies with learned imagination rollouts from an environment model.
Benchmark Rows2
FAQ Entries2
Related Models4
Related Guides0
Related Research Topics1
Last Updated2026-01-20

Notable Features

Key capabilities associated with this model.

  • Combines model-free and model-based strengths
  • Tolerates imperfect environment models
  • Rollout encoder aggregates imagined futures
  • Improved Sokoban puzzle solving

Use Cases

Representative applications attached to this model record.

Puzzle-solving (Sokoban)Atari gamesPlanning-augmented RLHybrid model-based/model-free RL

Strengths and Limitations

Balanced assessment surfaced in static HTML.

Strengths

  • Robust to model errors
  • Improves model-free baselines
  • Conceptually elegant hybrid approach
  • Early demonstration of imagination value

Limitations

  • Environment model quality still matters
  • Computational overhead of imagination rollouts
  • Superseded by Dreamer family

Benchmarks

Published benchmark evidence attached to this model record.

BenchmarkMetricResultSource
SokobanSolve Rate 87 %Significant improvement over model-freeSource
AtariMean HNS 1.15 x baselineImproved over baselinesSource

References and Citations

Primary references preserved in static HTML for citation extraction.

ReferenceLink
Weber et al., 2017. Imagination-Augmented Agents for Deep Reinforcement Learning. NeurIPS 2017.Open source

Related Models

Nearby models linked from the current editorial record.

ModelCategoryWorld Model TypeIndex v1.1
MuZeroModel-Based RLAbstract learned dynamics + MCTS78/100
DreamerV3Model-Based RLImagination-based dynamics model88/100
PredictronModel-Based RLAbstract internal dynamics model43/100
World Models (Ha & Schmidhuber)Model-Based RLGenerative latent dynamics model48/100

Direct Comparisons

Side-by-side comparisons already connected to this model.

ComparisonMatchupSummary
Model-Based RL vs Model-Free RLModel-Based RL vs Model-Free RLModel-based RL learns a world model for imagination-based planning. Model-free RL learns directly from interaction without an internal model. Each approach has distinct strengths depending on the application domain.

Research Topics Referencing This Model

Connected research areas surfaced directly in static HTML.

TopicSummary
Model-Based Reinforcement LearningWhat model-based reinforcement learning is, how world models enable imagination-based planning, and why Dreamer, MuZero, PlaNet, and TD-MPC2 matter.

Frequently Asked Questions

FAQ answers rendered directly into static HTML for extractable responses.

How do I2As use imagination?

I2As generate imagined future trajectories using a learned environment model, encode them with a rollout encoder, and feed the encoded imaginations as additional inputs to the policy, augmenting rather than replacing model-free decision-making.

Why not just use the model directly for planning?

Learned environment models are imperfect. I2As use imagination as supplementary information rather than relying on it entirely, making the system robust to model errors.

Quick Answer

Short extractable summary preserved directly in static HTML.

  • Imagination-Augmented Agents (I2A) is an imagination-augmented model-free agent developed by Google DeepMind in 2017 for atari / planning.
  • Use this page when you need a fast read on how Imagination-Augmented Agents (I2A) fits into the model-based rl landscape, then validate the details in the benchmarks, citations, and related pages.
  • A key strength surfaced in the editorial record is robust to model errors.

Editorial Trust Signals

Editorial provenance and refresh policy preserved directly in static HTML.

Published by world-models.io editorial board.

Lead editor Tyler D. - Technical editor, methodology and benchmark analysis.

This model page synthesizes primary papers, official model pages, benchmark evidence, and related world-models.io context into a reference resource.

Each editorial page is assembled from primary sources, normalized into extractable summaries, checked for factual drift, and reviewed before publication or major refreshes. Last reviewed: 2026-01-20.

Pages are refreshed when a new paper, benchmark, release, architecture update, or stronger primary source materially changes the answer a reader or AI system should retrieve.

Each page links back to relevant primary sources and keeps a stable canonical URL so readers can verify claims, trace context, and reference the most up-to-date version. See the editorial policy.

Primary sources onlyLast reviewed date visibleMethodology documentedSource links included

External Sources

Primary model and lab sources embedded in static HTML.

References

  1. [1] Weber et al., 2017. Imagination-Augmented Agents for Deep Reinforcement Learning. NeurIPS 2017.