Instructions to use JayCao99/smolvla-rm65b-sort-v0.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use JayCao99/smolvla-rm65b-sort-v0.0 with LeRobot:
# See https://github.com/huggingface/lerobot?tab=readme-ov-file#installation for more details git clone https://github.com/huggingface/lerobot.git cd lerobot pip install -e .[smolvla]
# Launch finetuning on your dataset python lerobot/scripts/train.py \ --policy.path=JayCao99/smolvla-rm65b-sort-v0.0 \ --dataset.repo_id=lerobot/svla_so101_pickplace \ --batch_size=64 \ --steps=20000 \ --output_dir=outputs/train/my_smolvla \ --job_name=my_smolvla_training \ --policy.device=cuda \ --wandb.enable=true
# Run the policy using the record function python -m lerobot.record \ --robot.type=so101_follower \ --robot.port=/dev/ttyACM0 \ # <- Use your port --robot.id=my_blue_follower_arm \ # <- Use your robot id --robot.cameras="{ front: {type: opencv, index_or_path: 8, width: 640, height: 480, fps: 30}}" \ # <- Use your cameras --dataset.single_task="Grasp a lego block and put it in the bin." \ # <- Use the same task description you used in your dataset recording --dataset.repo_id=HF_USER/dataset_name \ # <- This will be the dataset name on HF Hub --dataset.episode_time_s=50 \ --dataset.num_episodes=10 \ --policy.path=JayCao99/smolvla-rm65b-sort-v0.0 - Notebooks
- Google Colab
- Kaggle
SmolVLA โ rm65b-sort-v0
LeRobot SmolVLA policy fine-tuned on rm65b-sort-v0 (bimanual RM65 sort task,
3 cameras, 198 episodes / 91.5k frames @ 30 Hz, 1 task).
Three candidate deployment checkpoints from the same training run.
| Subfolder | Train step | Final train loss |
|---|---|---|
checkpoint-025000 |
25,000 | 0.036 |
checkpoint-035000 |
35,000 (best logged loss) | 0.033 |
checkpoint-045000 |
45,000 (last on disk) | 0.034 |
Loss flatlined after step ~30K once the cosine LR clamped at its minimum (2.5e-6); the three checkpoints sample the early plateau, best loss, and final state respectively.
Training summary
- Architecture: SmolVLA (LeRobot)
- Batch size 128, cosine LR (peak ~1e-4, min 2.5e-6), AMP
- Hardware: 1ร A100-80g, ~24 h wall-clock
See each checkpoint-XXXXXX/train_config.json for the full reproducible config.
Usage
from huggingface_hub import snapshot_download
from lerobot.policies.smolvla import SmolVLAPolicy
ckpt_dir = snapshot_download("JayCao99/smolvla-rm65b-sort-v0", allow_patterns="checkpoint-045000/*")
policy = SmolVLAPolicy.from_pretrained(f"{ckpt_dir}/checkpoint-045000")