--- title: "RT-2 vs 3D-VLA | Robotic World Models Compared | world-models.io" canonical: "https://world-models.io/en/compare/rt-2-vs-3d-vla/" description: "Comparing RT-2 and 3D-VLA: two approaches to connecting vision-language models with robotic action. Review RT-2 vs 3D-VLA: evidence, scope, limitations." author: "Bernard Grenat" generated: "2026-10-23" --- New: the Timeline is live. Track world model releases, papers, and benchmark updates in real time. The Knowledge Hub for AI World Models # RT-2 vs 3D-VLA RT-2 vs 3D-VLA compares two Vision-Language-Action architectures: RT-2 transfers web knowledge to robot control, while 3D-VLA integrates 3D spatial understanding. robotics model-based-rl simulation embodied-ai ## What is a world model? A world model is an AI system that learns a predictive representation of how an environment changes over time. It can use observations, actions, or language to estimate future states and possible outcomes before an agent acts. World models support planning in model-based reinforcement learning, robotics, embodied AI, autonomous driving, and interactive simulation. This site catalogs these systems with model records, research papers, benchmark context, and source links. Start with the [world models database](https://world-models.io/en/world-models-database/), compare systems on the [leaderboard](https://world-models.io/en/leaderboard/), or read the [Performance Index methodology](https://world-models.io/en/methodology/performance-index/). ## Comparison Overview Main comparison summary preserved directly in static HTML. Two approaches to vision-language-action models for robotics. RT-2 leverages web-scale VLM knowledge through action tokenization, while 3D-VLA integrates explicit 3D spatial understanding for embodied reasoning. ## Verdict Primary editorial conclusion preserved for non-JS crawlers and readers. RT-2 demonstrates that web-scale knowledge can be effectively transferred to robotics through simple action tokenization, enabling emergent capabilities. 3D-VLA takes a more structured approach with explicit 3D understanding. RT-2 is more mature and validated; 3D-VLA represents the next frontier of spatial-aware embodied AI. ## Key Differences Extractable difference list generated from the comparison table. - **Architecture:** RT-2 - PaLI-X / PaLM-E backbone with action tokenization; 3D-VLA - 3D-aware VLA with integrated world model. - **Knowledge Source:** RT-2 - Web-scale vision-language data + robot trajectories; 3D-VLA - 3D scenes + language + robot demonstrations. - **Spatial Understanding:** RT-2 - Implicit (from 2D images); 3D-VLA - Explicit 3D scene representations. - **Generalization:** RT-2 - Strong emergent reasoning about novel objects; 3D-VLA - 3D-aware planning and manipulation. - **Lab:** RT-2 - Google DeepMind; 3D-VLA - Multi-university. ## When To Use Each Static decision guidance for no-JS readers. ### Choose RT-2 when... Choose RT-2 when its documented capabilities match your research or deployment requirements. ### Choose 3D-VLA when... Choose 3D-VLA when its documented capabilities match your research or deployment requirements. ## Comparison Table RT-2 demonstrates that web-scale knowledge can be effectively transferred to robotics through simple action tokenization, enabling emergent capabilities. 3D-VLA takes a more structured approach with explicit 3D understanding. RT-2 is more mature and validated; 3D-VLA represents the next frontier of spatial-aware embodied AI. | Dimension | RT-2 | 3D-VLA | | --- | --- | --- | | Architecture | PaLI-X / PaLM-E backbone with action tokenization | 3D-aware VLA with integrated world model | | Knowledge Source | Web-scale vision-language data + robot trajectories | 3D scenes + language + robot demonstrations | | Spatial Understanding | Implicit (from 2D images) | Explicit 3D scene representations | | Generalization | Strong emergent reasoning about novel objects | 3D-aware planning and manipulation | | Lab | Google DeepMind | Multi-university | | Year | 2023 | 2024 | ## Performance Index Snapshot High-level scoring context for the models referenced in this comparison. | Model | Category | Index v1.1 | Confidence | | --- | --- | --- | --- | | RT-2 | Foundation World Model | 72/100 | medium | | 3D-VLA | Foundation World Model | 47/100 | low | | AMI World Model | Foundation World Model | N/A | N/A | | TD-MPC2 | Model-Based RL | 80/100 | high | ## Frequently Asked Questions FAQ answers rendered directly into static HTML for extractable responses. ### Which approach is better for real-world robotics? RT-2 is more validated on real robots. 3D-VLA's explicit 3D understanding could provide advantages for spatial reasoning tasks but is less proven in practice. ## Quick Answer Short extractable summary preserved directly in static HTML. - RT-2 vs 3D-VLA: this page compares where each system is stronger instead of forcing a universal winner. - Use the verdict for the short answer, then validate the trade-offs in the table, evidence sources, and benchmark context. - Related models and source links help connect this comparison to the broader world models landscape. ## Editorial Trust Signals Editorial provenance and refresh policy preserved directly in static HTML. **Published by** world-models.io editorial board. **Lead editor** Bernard Grenat. This comparison page publishes a direct answer, explicit trade-offs, and source-backed evidence that can be validated against primary materials. Each editorial page is assembled from primary sources, normalized into extractable summaries, checked for factual drift, and reviewed before publication or major refreshes. Last reviewed: 2026-09-27. Pages are refreshed when a new paper, benchmark, release, architecture update, or stronger primary source materially changes the answer a reader or AI system should retrieve. Each page links back to relevant primary sources and keeps a stable canonical URL so readers can verify claims, trace context, and reference the most up-to-date version. [See the editorial policy.](https://world-models.io/en/editorial-policy/) Primary sources only Last reviewed date visible Methodology documented Source links included Correction channel published Review date visible ## External Sources Primary papers and official sources for the models discussed on this comparison page. - [RT-2 paper](https://arxiv.org/abs/2307.15818) Google DeepMind primary research source - [RT-2 official page](https://robotics-transformer2.github.io/) Google DeepMind official page - [3D-VLA paper](https://arxiv.org/abs/2403.09631) MIT / Tsinghua primary research source - [TD-MPC2 paper](https://arxiv.org/abs/2310.16828) MIT / Meta primary research source