---
title: "Value Prediction Network | Abstract Planning | world-models.io"
canonical: "https://world-models.io/en/models/value-prediction-network/"
description: "The Value Prediction Network learns abstract state dynamics for planning and value estimation in reinforcement learning."
author: "Tyler D."
generated: "2026-10-30"
---

New: the Timeline is live. Track world model releases, papers, and benchmark updates in real time.

The Knowledge Hub for AI World Models

# Value Prediction Network

The Value Prediction Network (VPN) learns an abstract world model optimized for value prediction, performing planning in a learned abstract state space.

robotics

model-based-rl

simulation

embodied-ai

## What is a world model?

A world model is an AI system that learns a predictive representation of how an environment changes over time. It can use observations, actions, or language to estimate future states and possible outcomes before an agent acts. World models support planning in model-based reinforcement learning, robotics, embodied AI, autonomous driving, and interactive simulation. This site catalogs these systems with model records, research papers, benchmark context, and source links. Start with the [world models database](https://world-models.io/en/world-models-database/), compare systems on the [leaderboard](https://world-models.io/en/leaderboard/), or read the [Performance Index methodology](https://world-models.io/en/methodology/performance-index/).

## Key Attributes

Static HTML snapshot of the model record for crawlers and no-JS readers.

| Attribute | Value |
| --- | --- |
| Model | Value Prediction Network (VPN) |
| Lab / Organization | DeepMind |
| Category | Model-Based RL |
| Subtype | Value-Targeted Dynamics Model |
| World Model Type | Value-focused abstract dynamics |
| Primary Domain | Planning / Games |
| Architecture | Abstract state transition model with value and reward prediction heads |
| Modality | Visual / Abstract states |
| Training Method | End-to-end training with value and reward prediction targets |
| Status | foundational |
| Year | 2017 |
| Performance Index | 43/100 (medium confidence, v1.1) |

## About Value Prediction Network (VPN)

Main editorial body preserved directly in static HTML.

The Value Prediction Network learns abstract state dynamics optimized for predicting future rewards and values rather than reconstructing raw observations. It performs multi-step planning in abstract space, rolling forward predictions of value through learned transitions. This approach avoids the pitfalls of pixel-level prediction while retaining the benefits of model-based planning. VPN showed that models optimized directly for value prediction can outperform both model-free methods and models that predict observations.

Value Prediction Network (VPN) is a value-focused abstract dynamics developed by University of Michigan / Google Brain in 2017 for planning / games.

## Editorial Snapshot

Short extractable facts for answer engines and no-JS readers.

| Signal | Value |
| --- | --- |
| Definition | Value Prediction Network (VPN) is a value-focused abstract dynamics developed by University of Michigan / Google Brain in 2017 for planning / games. |
| Short Description | A neural network that learns to plan by predicting future values and rewards through abstract state transitions, without reconstructing observations. |
| Benchmark Rows | 1 |
| FAQ Entries | 1 |
| Related Models | 2 |
| Related Guides | 0 |
| Related Research Topics | 1 |
| Last Updated | 2026-01-15 |

## Notable Features

Key capabilities associated with this model.

- • Abstract dynamics optimized for value prediction
- • No observation reconstruction
- • Multi-step lookahead planning
- • Bridges model-free and model-based RL

## Use Cases

Representative applications attached to this model record.

Value-based planning

Atari games

Abstract decision-making

## Strengths and Limitations

Balanced assessment surfaced in static HTML.

### Strengths

- • No reconstruction loss needed
- • Focused on decision-relevant predictions
- • Efficient planning in abstract space
- • Theoretically clean approach

### Limitations

- • Limited domain validation
- • Abstract space lacks interpretability
- • Superseded by Predictron and MuZero

## Benchmarks

Published benchmark evidence attached to this model record.

| Benchmark | Metric | Result | Source |
| --- | --- | --- | --- |
| Atari | Mean HNS 1.08 x baseline | Improved over model-free baselines | [Source](https://arxiv.org/abs/1707.03497) |

## References and Citations

Primary references preserved in static HTML for citation extraction.

| Reference | Link |
| --- | --- |
| Oh et al., 2017. Value Prediction Network. NeurIPS 2017. | [Open source](https://arxiv.org/abs/1707.03497) |

## Related Models

Nearby models linked from the current editorial record.

| Model | Category | World Model Type | Index v1.1 |
| --- | --- | --- | --- |
| [Predictron](https://world-models.io/en/models/predictron/) | Model-Based RL | Abstract internal dynamics model | 43/100 |
| [MuZero](https://world-models.io/en/models/muzero/) | Model-Based RL | Abstract learned dynamics + MCTS | 78/100 |

## Direct Comparisons

Side-by-side comparisons already connected to this model.

| Comparison | Matchup | Summary |
| --- | --- | --- |
| [Predictron vs MuZero](https://world-models.io/en/compare/predictron-vs-muzero/) | Predictron vs MuZero | Both learn abstract dynamics models for planning without requiring environment reconstruction, but Predictron was an early prototype while MuZero became the definitive realization of value-equivalent model learning. |

## Research Topics Referencing This Model

Connected research areas surfaced directly in static HTML.

| Topic | Summary |
| --- | --- |
| [Model-Based Reinforcement Learning](https://world-models.io/en/research/model-based-rl/) | What model-based reinforcement learning is, how world models enable imagination-based planning, and why Dreamer, MuZero, PlaNet, and TD-MPC2 matter. |

## Frequently Asked Questions

FAQ answers rendered directly into static HTML for extractable responses.

### How does VPN differ from the Predictron?

Both predict values in abstract space, but VPN explicitly learns state transitions and reward predictions along imagined trajectories, while the Predictron uses a single network with λ-weighted returns across depths.

## Quick Answer

Short extractable summary preserved directly in static HTML.

- Value Prediction Network (VPN) is a value-focused abstract dynamics developed by University of Michigan / Google Brain in 2017 for planning / games.
- Use this page when you need a fast read on how Value Prediction Network (VPN) fits into the model-based rl landscape, then validate the details in the benchmarks, citations, and related pages.
- A key strength surfaced in the editorial record is no reconstruction loss needed.

## Editorial Trust Signals

Editorial provenance and refresh policy preserved directly in static HTML.

**Published by** world-models.io editorial board.

**Lead editor** Tyler D. - Technical editor, methodology and benchmark analysis.

This model page synthesizes primary papers, official model pages, benchmark evidence, and related world-models.io context into a reference resource.

Each editorial page is assembled from primary sources, normalized into extractable summaries, checked for factual drift, and reviewed before publication or major refreshes. Last reviewed: 2026-01-15.

Pages are refreshed when a new paper, benchmark, release, architecture update, or stronger primary source materially changes the answer a reader or AI system should retrieve.

Each page links back to relevant primary sources and keeps a stable canonical URL so readers can verify claims, trace context, and reference the most up-to-date version. [See the editorial policy.](https://world-models.io/en/editorial-policy/)

Primary sources only

Last reviewed date visible

Methodology documented

Source links included

Correction channel published

Review date visible

## External Sources

Primary model and lab sources embedded in static HTML.

- [Value Prediction Network (VPN) paper](https://arxiv.org/abs/1707.03497) University of Michigan / Google Brain primary research source
- [Google DeepMind official website](https://deepmind.google) Related lab

## References

1. [[1] Oh et al., 2017. Value Prediction Network. NeurIPS 2017.](https://arxiv.org/abs/1707.03497)