Instructions to use tonghuiwang123/so100-diffusion-new60 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use tonghuiwang123/so100-diffusion-new60 with LeRobot:
- Notebooks
- Google Colab
- Kaggle
so100-diffusion-new60
ACT policy for SO-ARM100 / SO100, task: Grab the white cube to the white cup
- 数据:
tonghuiwang123/40— 40 episodes / 8482 frames / 30fps / 2×1280x720(新相机) - Checkpoint: step 030000 ≈ 226.4 epoch(有效 batch 64)
- 推理显存: 约 0.70 GB
- Diffusion Policy 从零训练;resize_shape=[180,320] crop_ratio=0.95(推理时自动生效,相机仍配 1280x720)
相机命名(顺序不能错;错了不报错但表现会莫名变差)
| 物理位置 | 设备 | 本模型要求的 key |
|---|---|---|
| 顶部 (top-down) | /dev/video2 |
front |
| 腕部 (wrist) | /dev/video4 |
side |
建议改用
/dev/v4l/by-id/...稳定路径——/dev/videoN重插 USB 会漂移。
部署
lerobot-record \
--robot.type=so100_follower --robot.port=/dev/ttyACM0 \
--robot.id=my_awesome_follower_arm \
--robot.cameras="{
front: {type: opencv, index_or_path: /dev/video2, width: 1280, height: 720, fps: 30},
side: {type: opencv, index_or_path: /dev/video4, width: 1280, height: 720, fps: 30},
}" \
--dataset.repo_id=tonghuiwang123/eval_so100-diffusion-new60 \
--dataset.single_task="Grab the white cube to the white cup" \
--policy.n_action_steps=15 \
--policy.path=tonghuiwang123/so100-diffusion-new60
分辨率必须 1280x720。中间 checkpoint 以分支提供:--policy.pretrained_revision=ckpt-XXXXXX
已知局限
训练数据仅覆盖工作区左半区(shoulder_pan ∈ [-48, +6]),且 28% 的样本集中在
pan ∈ [-25,-20) 一格。方块放到覆盖稀疏的位置时成功率会明显下降。
- Downloads last month
- -