---
title: "Copilot4D | 4D LiDAR World Model | world-models.io"
canonical: "https://world-models.io/en/models/copilot4d/"
description: "Copilot4D is a 4D LiDAR world model for autonomous driving developed by Waabi. Review Copilot4D: evidence, scope, limitations, and primary sources."
author: "Tyler D."
generated: "2026-10-30"
---

New: the Timeline is live. Track world model releases, papers, and benchmark updates in real time.

The Knowledge Hub for AI World Models

# Copilot4D

Copilot4D is a 4D LiDAR-based world model for autonomous driving that predicts future 3D point cloud sequences for planning and safety.

robotics

model-based-rl

simulation

embodied-ai

## What is a world model?

A world model is an AI system that learns a predictive representation of how an environment changes over time. It can use observations, actions, or language to estimate future states and possible outcomes before an agent acts. World models support planning in model-based reinforcement learning, robotics, embodied AI, autonomous driving, and interactive simulation. This site catalogs these systems with model records, research papers, benchmark context, and source links. Start with the [world models database](https://world-models.io/en/world-models-database/), compare systems on the [leaderboard](https://world-models.io/en/leaderboard/), or read the [Performance Index methodology](https://world-models.io/en/methodology/performance-index/).

## Key Attributes

Static HTML snapshot of the model record for crawlers and no-JS readers.

| Attribute | Value |
| --- | --- |
| Model | Copilot4D |
| Lab / Organization | Waabi |
| Category | Foundation World Model |
| Subtype | 4D Point Cloud World Model |
| World Model Type | Spatiotemporal LiDAR world model |
| Primary Domain | Autonomous driving |
| Architecture | Discrete diffusion transformer over VQ-VAE tokenized LiDAR point clouds |
| Modality | LiDAR point clouds (4D) |
| Training Method | VQ-VAE tokenization of point clouds + discrete diffusion for spatiotemporal prediction |
| Status | active |
| Year | 2023 |
| Performance Index | 57/100 (medium confidence, v1.1) |

## About Copilot4D

Main editorial body preserved directly in static HTML.

Copilot4D learns a world model over 4D (3D + time) LiDAR point cloud data for autonomous driving. Using a discrete diffusion approach over tokenized point clouds, it predicts future 3D scenes with high fidelity. The model captures complex driving dynamics including vehicle motion, pedestrian behavior, and environmental changes, enabling closed-loop simulation for self-driving development.

Copilot4D is a spatiotemporal lidar world model developed by Waabi in 2023 for autonomous driving.

## Editorial Snapshot

Short extractable facts for answer engines and no-JS readers.

| Signal | Value |
| --- | --- |
| Definition | Copilot4D is a spatiotemporal lidar world model developed by Waabi in 2023 for autonomous driving. |
| Short Description | A world model for autonomous driving that predicts future LiDAR point clouds in 4D (3D space + time) using discrete diffusion. |
| Benchmark Rows | 1 |
| FAQ Entries | 1 |
| Related Models | 2 |
| Related Guides | 0 |
| Related Research Topics | 0 |
| Last Updated | 2026-03-08 |

## Notable Features

Key capabilities associated with this model.

- • 4D spatiotemporal prediction
- • Discrete diffusion over LiDAR tokens
- • Closed-loop simulation capability
- • Captures complex driving dynamics

## Use Cases

Representative applications attached to this model record.

Autonomous driving simulation

Closed-loop testing

Point cloud forecasting

Safety-critical scenario generation

## Strengths and Limitations

Balanced assessment surfaced in static HTML.

### Strengths

- • Native 3D understanding
- • High-fidelity point cloud prediction
- • Closed-loop simulation
- • Practical AV application

### Limitations

- • LiDAR-specific (no RGB)
- • Proprietary
- • Domain-limited to driving

## Benchmarks

Published benchmark evidence attached to this model record.

| Benchmark | Metric | Result | Source |
| --- | --- | --- | --- |
| Point Cloud Forecasting | Chamfer Distance 0.42 CD↓ | State-of-the-art | [Source](https://arxiv.org/abs/2311.01017) |

## References and Citations

Primary references preserved in static HTML for citation extraction.

| Reference | Link |
| --- | --- |
| Zhang et al., 2023. Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion. | [Open source](https://arxiv.org/abs/1803.10122) |

## Related Models

Nearby models linked from the current editorial record.

| Model | Category | World Model Type | Index v1.1 |
| --- | --- | --- | --- |
| [GAIA-1](https://world-models.io/en/models/gaia-1/) | Foundation World Model | Generative driving world model | 61/100 |
| [NVIDIA Cosmos](https://world-models.io/en/models/nvidia-cosmos/) | Foundation World Model | Video world foundation model | 87/100 |

## Direct Comparisons

Side-by-side comparisons already connected to this model.

| Comparison | Matchup | Summary |
| --- | --- | --- |
| [GAIA-1 vs Copilot4D](https://world-models.io/en/compare/gaia-1-vs-copilot4d/) | GAIA-1 (Wayve) vs Copilot4D (Waabi) | Both are world models designed for autonomous driving, but they operate on different sensor modalities: GAIA-1 generates camera video, while Copilot4D predicts LiDAR point clouds in 4D. |
| [GAIA-1 vs NVIDIA Cosmos](https://world-models.io/en/compare/gaia-1-vs-nvidia-cosmos/) | GAIA-1 vs NVIDIA Cosmos | Both are video-based world models for autonomous driving and physical AI, but GAIA-1 is a domain-specific driving world model from Wayve while Cosmos is a general-purpose foundation platform from NVIDIA. |
| [Copilot4D vs GAIA-1](https://world-models.io/en/compare/copilot4d-vs-gaia-1/) | Copilot4D vs GAIA-1 | Both target autonomous driving simulation but from different angles: Copilot4D predicts 4D point cloud futures for safety-critical planning, while GAIA-1 generates photorealistic driving video for scenario exploration. |
| [GAIA-1 vs Sora](https://world-models.io/en/compare/gaia-1-vs-sora/) | GAIA-1 vs Sora | Two generative world models that approach video generation from different angles: GAIA-1 focuses on autonomous driving simulation, while Sora aims to be a general-purpose visual world simulator. |
| [Copilot4D vs GAIA-1](https://world-models.io/en/compare/copilot4d-vs-gaia-1/) | Copilot4D vs GAIA-1 | Two autonomous driving world models with different approaches: Copilot4D uses discrete tokenization for LiDAR point cloud forecasting, while GAIA-1 generates photorealistic driving videos from multimodal inputs. |
| [MILE vs GAIA-1](https://world-models.io/en/compare/mile-vs-gaia-1/) | MILE vs GAIA-1 | Both from Wayve, these models represent two generations of driving world models. MILE focuses on actionable imagination for planning, while GAIA-1 scales to photorealistic scenario generation. |

## Frequently Asked Questions

FAQ answers rendered directly into static HTML for extractable responses.

### Why use LiDAR instead of video for driving world models?

LiDAR provides native 3D geometry, making it easier to reason about distances, object shapes, and spatial relationships critical for safe autonomous driving.

## Quick Answer

Short extractable summary preserved directly in static HTML.

- Copilot4D is a spatiotemporal lidar world model developed by Waabi in 2023 for autonomous driving.
- Use this page when you need a fast read on how Copilot4D fits into the foundation world model landscape, then validate the details in the benchmarks, citations, and related pages.
- A key strength surfaced in the editorial record is native 3D understanding.

## Editorial Trust Signals

Editorial provenance and refresh policy preserved directly in static HTML.

**Published by** world-models.io editorial board.

**Lead editor** Tyler D. - Technical editor, methodology and benchmark analysis.

This model page synthesizes primary papers, official model pages, benchmark evidence, and related world-models.io context into a reference resource.

Each editorial page is assembled from primary sources, normalized into extractable summaries, checked for factual drift, and reviewed before publication or major refreshes. Last reviewed: 2026-03-08.

Pages are refreshed when a new paper, benchmark, release, architecture update, or stronger primary source materially changes the answer a reader or AI system should retrieve.

Each page links back to relevant primary sources and keeps a stable canonical URL so readers can verify claims, trace context, and reference the most up-to-date version. [See the editorial policy.](https://world-models.io/en/editorial-policy/)

Primary sources only

Last reviewed date visible

Methodology documented

Source links included

Correction channel published

Review date visible

## External Sources

Primary model and lab sources embedded in static HTML.

- [Copilot4D paper](https://arxiv.org/abs/2311.01017) Waabi primary research source
- [Copilot4D cited source](https://arxiv.org/abs/1803.10122) Zhang et al., 2023. Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion.
- [Waabi official website](https://waabi.ai) Related lab

## References

1. [[1] Zhang et al., 2023. Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion.](https://arxiv.org/abs/1803.10122)