Instructions to use The-Hidden-Canopy/omni-q-table-checkpoints with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use The-Hidden-Canopy/omni-q-table-checkpoints with LeRobot:
# See https://github.com/huggingface/lerobot?tab=readme-ov-file#installation for more details git clone https://github.com/huggingface/lerobot.git cd lerobot pip install -e .[smolvla]
# Launch finetuning on your dataset python lerobot/scripts/train.py \ --policy.path=The-Hidden-Canopy/omni-q-table-checkpoints \ --dataset.repo_id=lerobot/svla_so101_pickplace \ --batch_size=64 \ --steps=20000 \ --output_dir=outputs/train/my_smolvla \ --job_name=my_smolvla_training \ --policy.device=cuda \ --wandb.enable=true
# Run the policy using the record function python -m lerobot.record \ --robot.type=so101_follower \ --robot.port=/dev/ttyACM0 \ # <- Use your port --robot.id=my_blue_follower_arm \ # <- Use your robot id --robot.cameras="{ front: {type: opencv, index_or_path: 8, width: 640, height: 480, fps: 30}}" \ # <- Use your cameras --dataset.single_task="Grasp a lego block and put it in the bin." \ # <- Use the same task description you used in your dataset recording --dataset.repo_id=HF_USER/dataset_name \ # <- This will be the dataset name on HF Hub --dataset.episode_time_s=50 \ --dataset.num_episodes=10 \ --policy.path=The-Hidden-Canopy/omni-q-table-checkpoints - Notebooks
- Google Colab
- Kaggle
OMNI-Q table-setting checkpoints (Intel Physical AI Online Challenge, 2026-09-16)
Training outputs of https://github.com/The-Hidden-Canopy/OMNI-Q_Weird_Stuff_Machine
(MIT). Fetch with bash scripts/fetch_checkpoints.sh from that repo.
| folder | what | license |
|---|---|---|
smolvla_so101_table/ |
SmolVLA action expert fine-tuned (8000 steps, batch 8) on 40 demonstration episodes recorded from the OMNI-Q dual SO-101 MuJoCo table-setting scene. Base: lerobot/smolvla_base (Hugging Face LeRobot). |
Apache-2.0, as the base model and LeRobot; attribution above. Derived weights; the base model's terms apply. |
omni_planner/ |
IDA Omni reference body (omni_planner_r1_final.pt, 1.8 GB) used as the plan-step reasoner with fenced decoding, plus its training receipt. Trained by The Hidden Canopy on plan-grammar traces. |
The Hidden Canopy LLC; gated access — request and it is auto-approved. Not for redistribution outside the gate without permission. |
How they are used (see SUBMISSION.md in the repo): the policy leads every
single-arm PICK/MOVE from three cameras + arm state + language; the governed
contact primitive completes the step; the reasoner proposes which object /
which arm next and the governed core validates and completes the plan.
Measured: VLA-first 10-seed harness 8/10 resolved (12/16 with seeded sampling);
OMNI-advised 10-seed montage 10/10 on the recorded seeds.
Environment variables the repo's scripts read:
OMNIQ_VLA_CHECKPOINT=<path>/smolvla_so101_table
OMNIQ_OMNI_REASONER=omni OMNIQ_OMNI_CHECKPOINT=<path>/omni_planner/omni_planner_r1_final.pt OMNIQ_OMNI_RECEIPT=<path>/omni_planner/omni_planner_r1_final_receipt.json