Persistent Planar Memory for Video World Models
Paper • 2610.23795 • Published • 3
How to use Robbyant-Research/PPMem with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
from diffusers.utils import load_image, export_to_video
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("Robbyant-Research/PPMem", dtype=torch.bfloat16, device_map="cuda")
pipe.to("cuda")
prompt = "A man with short gray hair plays a red electric guitar."
image = load_image(
"https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png"
)
output = pipe(image=image, prompt=prompt).frames[0]
export_to_video(output, "output.mp4")Yuze He1,2, Bin Tan2, Zelin Gao3,2, Yujun Shen2, Yong-Jin Liu1,*, Nan Xue2,*, Yinghao Xu3,2
1Tsinghua University
2Ant Group
3HKUST
*Corresponding authors.
NeurIPS 2026
Project page · Paper · Code
PPMem generates videos from a single image and a camera trajectory. It accumulates reconstructed 3D planes in a persistent memory and projects them into new views to condition subsequent video segments.
PPMem extends Wan 2.2 TI2V-5B with depth-token fusion, a feature decoder, a plane head, and rank-256 attention LoRA.
| Property | Value |
|---|---|
| Base model | Wan 2.2 TI2V-5B |
| Weight format | Sharded safetensors |
| Precision | bfloat16 |
| Path | Contents |
|---|---|
model.safetensors.index.json |
Tensor-to-shard mapping. |
model-0000x-of-00003.safetensors |
PPMem weights. |
vae/ |
Wan 2.2 VAE. |
text_encoder/ |
Wan 2.2 text encoder. |
tokenizer/ |
Wan 2.2 tokenizer. |
assets/ |
Demonstration video and its poster, used by this page. |
@article{he2026ppmem,
title = {Persistent Planar Memory for Video World Models},
author = {He, Yuze and Tan, Bin and Gao, Zelin and Shen, Yujun
and Liu, Yong-Jin and Xue, Nan and Xu, Yinghao},
journal = {arXiv preprint arXiv:2610.23795},
year = {2026}
}
PPMem is licensed under Apache 2.0. The bundled VAE, text encoder, and tokenizer are from Wan 2.2 TI2V-5B, also licensed under Apache 2.0.
Base model
Wan-AI/Wan2.2-TI2V-5B-Diffusers