Wjjjh/lingbot-va-libero-spatial

LingBot-VA LIBERO-Spatial

This repository contains community post-trained transformer checkpoints for LingBot-VA on the LIBERO-Spatial suite. It is not an official Robbyant model release.

The checkpoints predict robot actions jointly with future visual observations. They are intended for research and evaluation in the LIBERO simulator.

Checkpoints

Repository path	Training step	Status	LIBERO-Spatial result
transformer/	5,000	Retrained default/final checkpoint	Three-seed evaluation in progress

This checkpoint was retrained from robbyant/lingbot-va-base after replacing an earlier incompatible LIBERO-Spatial dataset export. Three explicit-seed evaluations are running over all 10 tasks with 50 episodes per task. This card will be updated with the final 1,500-episode aggregate after all runs finish.

Model contents

This repository provides the post-trained transformer only. The VAE, tokenizer, and text encoder must be taken from robbyant/lingbot-va-base.

The checkpoint config is saved with:

{"attn_mode": "flex"}

flex is the training setting. For inference or evaluation, copy the checkpoint into a runtime model directory and change attn_mode to torch or flashattn, following the official LingBot-VA instructions. Do not overwrite the archived training checkpoint merely to switch inference backends.

Download

Download the final 5,000-step transformer:

hf download Wjjjh/lingbot-va-libero-spatial \
  --include "transformer/*" \
  --local-dir lingbot-va-libero-spatial-step5000

Training details

Setting	Value
Initialization	robbyant/lingbot-va-base
Dataset	Wjjjh/libero_lingbot_va, libero_spatial subset
Dataset size	500 episodes, 62,250 action rows
Optimizer	AdamW
Learning rate	1e-5
Betas	(0.9, 0.95)
Weight decay	0.1
Warmup	10 optimizer steps
Precision	bfloat16
Distributed strategy	FSDP
Hardware	4 × NVIDIA H100 80 GB
Per-GPU batch size	1
Gradient accumulation	8
Effective global batch size	32
Total optimizer steps	5,000
Checkpoint interval	200 steps

Training followed the LingBot-VA LIBERO post-training pipeline, with a suite-specific action normalization computed from all LIBERO-Spatial training actions.

Action and evaluation configuration

The model uses the first seven channels of the 30-channel action layout:

used_action_channel_ids = [0, 1, 2, 3, 4, 5, 6]
action_snr_shift = 0.05

The action quantiles used for both training and evaluation are:

{
  "q01": [
    -0.7607142857142858,
    -0.6562499999999999,
    -0.9375,
    -0.10821428571428572,
    -0.20464285714285715,
    -0.18642857142857147,
    -1.0
  ],
  "q99": [
    0.9375,
    0.8732142857142857,
    0.9348214285714286,
    0.10500000000000001,
    0.17571428571428574,
    0.14357142857142857,
    1.0
  ]
}

The running 5,000-step evaluations use:

• LIBERO-Spatial, 10 tasks
• 50 episodes per task (500 total)
• maximum 800 environment steps per episode
• 128 × 128 agent-view and eye-in-hand observations
• 4 parallel GPU shards
• explicit seeds 2026072501, 2026072502, and 2026072503
• LIBERO commit 8f1084e3132a39270c3a13ebe37270a43ece2a01

Limitations

• The retrained 5,000-step checkpoint evaluation is still in progress; no final success rate is claimed yet.
• Results are simulator- and configuration-dependent.
• This model has not been validated for safe real-world robot deployment.
• These files contain model weights only and do not contain optimizer state, so they are not a complete resumable training checkpoint.

Acknowledgements and citation

This checkpoint is derived from the official LingBot-VA base model and training code. Please cite the original LingBot-VA work when using this model:

@article{lingbot-va2026,
  title={Causal World Modeling for Robot Control},
  author={Li, Lin and Zhang, Qihang and Luo, Yiming and Yang, Shuai and Wang, Ruilin and Han, Fei and Yu, Mingrui and Gao, Zelin and Xue, Nan and Zhu, Xing and Shen, Yujun and Xu, Yinghao},
  journal={arXiv preprint arXiv:2601.21998},
  year={2026}
}