Video Prediction Policy 2: A 14B Model Beats π0.5 by 18.5 Points on Zero-Shot ALOHA (2610.10270)
Video Prediction Policy 2 (arXiv 2610.10270) reports 58.5% zero-shot ALOHA success vs 40.0% for π0.5. What the paper shows and where the evidence is thin.
Video Prediction Policy 2 (VPP2), arXiv 2610.10270, reports 58.5% average success on 10 real-world zero-shot ALOHA task categories, against 40.0% for π0.5 and 20.5% for Fast-WAM. That is an 18.5 point lead over the strongest baseline. The paper, by Yanjiang Guo and 17 co-authors, was submitted on 7 October 2026 (v2 on 8 October), and all numbers below are the authors' own results.
What is Video Prediction Policy 2?
VPP2 is a world action model (WAM): a robot policy that reuses the priors of a video-generation model to predict what should happen next, then turns that prediction into actions. It builds on Wan2.1-I2V-14B, adds a 0.9B-parameter action expert, and targets "strong zero-shot generalization in both video prediction and action generation," according to the abstract.
It follows the original Video Prediction Policy, which fine-tuned a video diffusion model and learned an inverse dynamics model on its internal representations.
What problem does VPP2 try to solve?
The authors say existing WAMs "frequently produce incorrect motion predictions in open-ended environments, leading to erroneous actions." They give two causes: base video models are not optimized for manipulation, and naively adding action components to a video model can substantially degrade its generalization.
So VPP2 attacks both: better video pretraining first, then an action module attached in a way meant to preserve the video model's behavior.
How does VPP2 work?
VPP2 trains in three stages, per the paper's HTML version.
- Event-level continued pretraining. Each training example is a full manipulation subtask with frames sampled across the whole event. The model predicts 49 frames at 416x240 for 30,000 steps with batch size 1,024, learning rate 1e-5 and a flow-matching loss. Clips run 1 to 12 seconds. Boundaries come from hand or end-effector velocity minima and gripper open/close moments, then a vision-language model refines them and writes captions.
- Chunk-level post-training and distillation. The model predicts a fixed chunk (2 seconds for human hands, 8 seconds for robots), then is distilled by consistency distillation into a single-step planner. The authors report about 0.12 seconds for one forward pass.
- Action module. A 0.9B diffusion transformer sits beside the video model in a mixture-of-transformers, conditioned on the video model's KV cache, and learns what the authors call an implicit inverse dynamics model. It uses 5 denoising steps for a 2-second action chunk, about 0.1 seconds, for roughly 0.22 seconds in total.
The training mix covers more than 20 robot embodiments, and the authors say egocentric bimanual data (ALOHA-style, humanoid, human egocentric) makes up more than 80% of it. Sources include OXE, DROID, AgiBot World-Beta, EgoDex, Ego4D and some self-collected ALOHA data.
What are the results?
The authors report three groups of results: video prediction, real-world ALOHA, and simulation benchmarks after benchmark-specific post-training.
Real-world zero-shot ALOHA (10 task categories, average success):
| Method | Success rate |
|---|---|
| VPP2 | 58.5% |
| π0.5 | 40.0% |
| Fast-WAM (Wan-14B version) | 20.5% |
The paper says VPP2 performs best in 9 of the 10 categories. Per-category numbers appear only in a figure.
Video prediction instruction-following (50 image-instruction pairs per domain, GPT-based evaluator):
| Method | Human hands | Robot |
|---|---|---|
| VPP2 | 0.80 | 0.90 |
| Cosmos3-64B | 0.70 | 0.78 |
| LVP | 0.62 | 0.46 |
| Cosmos3-16B | 0.44 | 0.32 |
| Wan2.1-14B | 0.32 | 0.04 |
The abstract's claim of an 11.0 point lead over Cosmos3-64B matches the gap between the two-column averages (0.85 against 0.74).
Simulation benchmarks (after benchmark-specific post-training):
| Benchmark | VPP2 | π0.5 | Best other listed |
|---|---|---|---|
| LIBERO-ID | 98.8 | 96.9 | DiT4DiT 98.6 |
| LIBERO-Pro overall | 45.0 | 11.0 | AtomVLA 6.3 |
| LIBERO-OOD overall | 63.9 | 26.8 | Temporal Ratio 59.4 |
| RoboDojo success rate (%) | 32.26 | 6.93 | GPT-6-Astra 22.48 |
The RoboDojo baselines come from the official leaderboard as of September 2026, and VPP2's RoboDojo numbers use full-task instructions without subtask planning. With a subtask planner on 5 task groups (50 trials per task), the authors report 57.6% average success against 27.6% for the baseline.
Does the evidence hold up?
The direction is plausible, but several details limit how far the headline travels.
- "Zero-shot" means zero task fine-tuning, not a new robot. The paper says the policy ran on "a robot embodiment seen during training, without task-specific fine-tuning." Self-collected ALOHA data is part of the training mix.
- The baselines are the authors' reruns. π0.5 and Fast-WAM were fine-tuned on all ALOHA datasets in VPP2's training data. That is a fair design, but it is not the same as comparing against published checkpoints, and it was done by the team that built VPP2.
- The sample is small and mostly hidden. The comparison averages 10 task categories. The main text gives per-category scores only in a figure, and a 40.0% versus 58.5% average from a handful of categories can move by several points with one or two categories changing. Confidence intervals are not reported in the main text.
- The video metric uses an automated judge. The 50 pairs per domain are scored by a GPT-based evaluator. Human pairwise win rates are also shown, but only as a figure.
- Benchmark selection. LIBERO-PRO argues that models scoring over 90% on standard LIBERO can fall sharply under perturbations. VPP2's own table fits that pattern: π0.5 scores 96.9 on LIBERO-ID but 11.0 on LIBERO-Pro. Comparisons on perturbed suites are informative, but VPP2 was post-trained for each benchmark, so the margin reflects the full pipeline, not only the pretrained model.
- No independent replication yet. The paper was submitted six days before this article's date.
How does VPP2 compare with related work?
| Model | Approach to video and action | Reported on |
|---|---|---|
| VPP2 | Pretrained video model, single-step planner, MoT action expert | ALOHA zero-shot, LIBERO-Pro, LIBERO-OOD, RoboDojo |
| π0.5 | Vision-language-action model co-trained on heterogeneous data | Open-world home tasks (authors' claim) |
| Fast-WAM | Keeps video modeling in training, predicts actions directly at inference (LeRobot docs) | Baseline in VPP2 |
| Original VPP | Inverse dynamics on video diffusion representations | Calvin ABC-D, real dexterous tasks |
The contrast with Fast-WAM is the interesting one. Fast-WAM asks whether a WAM needs test-time future imagination at all. VPP2 keeps a visual plan at inference but makes it a single step, so it argues that the quality of the prediction matters, not whether one exists. In VPP2's ALOHA table, Fast-WAM scores 20.5% against 58.5%, but the two systems differ in more than that one design choice, so the gap does not isolate the cause.
What does a working researcher take from this?
- Event-level prediction targets matter in the video evaluation. The ablation "VPP2-Fixed-Step", which predicts a fixed-duration chunk rather than a complete event, scores 0.48 human and 0.42 robot against 0.80 and 0.90 for full VPP2. That is a video-prediction result, not a real-world robot result.
- Check latency on your hardware. The authors report about 0.22 seconds per 2-second action chunk, and the main text does not name the hardware.
- Check the embodiment. If your robot is not in the training mix, the ALOHA result does not tell you what to expect.
- Read the figure, not the average. Per-category results decide whether the lead is broad or driven by a few tasks.
What's still unclear?
- How many trials were run per ALOHA task, and how large the per-category variance is.
- How much of the ALOHA gain comes from the video pretraining, the distillation, or the MoT action module, since the main text does not provide a full ablation of the real-world result.
- Whether the lead holds on an embodiment outside the training mix.
- Whether the released code and checkpoints reproduce the numbers. The authors say they are on the project website at robert-gyj.github.io/video-prediction-policy-2.
- Whether the paper's limitations are discussed. The conclusion in the main text summarizes results and points to preserving "generalizable video predictions" during action learning, and does not list limitations.
We read: the full main text of the paper (arXiv HTML v2). The appendices were not part of this read, so claims here rest on the main text, tables and abstract.
Frequently asked questions
What is Video Prediction Policy 2 (VPP2)?
VPP2 is a world action model from Yanjiang Guo and colleagues (arXiv 2610.10270, submitted 7 October 2026). It continues pretraining the Wan2.1-I2V-14B video model on manipulation videos, distills it into a single-step visual planner, and adds a 0.9B action expert. The authors report it beats pi0.5 and Fast-WAM on zero-shot ALOHA tasks.
How big is the gap between VPP2 and π0.5?
On 10 real-world ALOHA task categories, the authors report 58.5% average success for VPP2 and 40.0% for π0.5, a gap of 18.5 percentage points. Fast-WAM scored 20.5%. These are the authors' own results, and the π0.5 and Fast-WAM baselines were fine-tuned by the authors on the same ALOHA data in VPP2's training mix.
Does 'zero-shot' mean the robot had never seen ALOHA data?
No. The paper says VPP2 was deployed on a robot embodiment seen during training, without task-specific fine-tuning. Zero-shot here means new tasks, not a new robot. That is a weaker claim than zero-shot transfer to an unseen embodiment.
How fast is VPP2 at inference?
The authors report about 0.12 seconds for the single-step video model and about 0.1 seconds for the action module with 5 denoising steps, for roughly 0.22 seconds per 2-second action chunk. Hardware used for the timing is not given in the main text.
Is the code available?
The paper's reproducibility statement says training configurations, code and model checkpoints are available on the project website, robert-gyj.github.io/video-prediction-policy-2. Check the site for the current state of the release before depending on it.
Sources
- Video Prediction Policy 2: Predict Better, Act Better (abstract), arXiv (2026-10-08)
- Video Prediction Policy 2: Predict Better, Act Better (HTML, v2), arXiv (2026-10-08)
- π0.5: a Vision-Language-Action Model with Open-World Generalization, PMLR (CoRL 2025) (2025-01-01)
- Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representations, arXiv (2025-01-01)
- LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorization, arXiv (2025-10-01)
- FastWAM, LeRobot documentation, Hugging Face (2026-10-13)