iSEE checkpoints
Every checkpoint the iSEE paper's tables and figures read: 35 files, 2.15 GB. Code, configs and the converted release weights: insait-institute/iSEE.
RandSF.Q and Loci-Looped were trained by us with their authors' code. Each folder also holds the config of the run that produced its checkpoint (settings.yaml, args.json, cfg.json, config.py).
checkpoints.tsv lists, for every file: md5, size, its original cluster path and the paper tables and figures that use it.
LA-CATER, static camera
| file | what | size (MB) |
|---|---|---|
lacater_static/isee/encoder_step100000.ckpt |
iSEE encoder | 122.9 |
lacater_static/isee/walker_s0_step2000.pt |
iSEE walker, seed 0 | 1.4 |
lacater_static/isee/walker_s1_step2000.pt |
iSEE walker, seed 1 | 1.4 |
lacater_static/isee/walker_s2_step2000.pt |
iSEE walker, seed 2 | 1.4 |
lacater_static/isee_fig1a/walker_vis_s0_step2000.pt |
visibility walker, seed 0 (Fig. 1a only) | 1.4 |
lacater_static/isee_fig1a/walker_vis_s1_step2000.pt |
visibility walker, seed 1 (Fig. 1a only) | 1.4 |
lacater_static/isee_fig1a/walker_vis_s2_step2000.pt |
visibility walker, seed 2 (Fig. 1a only) | 1.4 |
lacater_static/slotcontrast/step100000.ckpt |
SlotContrast baseline | 125.7 |
lacater_static/ablations/isee_dino/step100000.ckpt |
ablation (tab:ablation): iSEE on stock DINOv2 | 125.0 |
lacater_static/ablations/isee_noapp/step100000.ckpt |
ablation (tab:sga): trained without sg(a) | 122.9 |
lacater_static/ablations/isee_ssall/step100000.ckpt |
ablation (tab:ssc-scope): slot-slot contrast on the whole slot | 122.9 |
lacater_static/ablations/pre4_twostream/step100000.ckpt |
earlier two-stream encoder behind the case counts of tab:cases | 122.9 |
lacater_static/randsfq/0042.pth |
RandSF.Q, trained by us | 139.7 |
lacater_static/loci_looped/net_900000.pt |
Loci-Looped, trained by us, step 900k | 33.5 |
LA-CATER, moving camera
| file | what | size (MB) |
|---|---|---|
lacater_moving/isee/encoder_step100000.ckpt |
iSEE encoder | 122.9 |
lacater_moving/isee/walker_s0_step2000.pt |
iSEE walker, seed 0 | 1.4 |
lacater_moving/isee/walker_s1_step2000.pt |
iSEE walker, seed 1 | 1.4 |
lacater_moving/isee/walker_s2_step2000.pt |
iSEE walker, seed 2 | 1.4 |
lacater_moving/slotcontrast/step100000.ckpt |
SlotContrast baseline | 125.7 |
lacater_moving/randsfq/0042.pth |
RandSF.Q, trained by us | 139.7 |
lacater_moving/loci_looped/net_170000.pt |
Loci-Looped, trained by us, step 170k | 44.1 |
KITTI tracking
| file | what | size (MB) |
|---|---|---|
kitti/isee/encoder_step22500.ckpt |
iSEE encoder, step 22.5k (tables) | 122.8 |
kitti/isee/encoder_step100000.ckpt |
iSEE encoder, step 100k (qualitative figure) | 122.8 |
kitti/isee/walker_seed0/walker_sd.pt |
iSEE walker trained on pseudo-occlusions | 0.4 |
kitti/isee/walker_seed0/ema_step800.pt |
iSEE walker, EMA weights at step 800 | 0.4 |
kitti/slotcontrast/step22500.ckpt |
SlotContrast baseline, step 22.5k (tables) | 125.3 |
kitti/slotcontrast/step100000.ckpt |
SlotContrast baseline, step 100k (qualitative figure) | 125.3 |
MOVi-C
| file | what | size (MB) |
|---|---|---|
movi_c/isee/encoder_best.ckpt |
iSEE encoder (discovery tables) | 36.5 |
movi_c/isee/encoder_best.live.ckpt |
iSEE encoder, live copy read by the dynamics pipeline | 98.5 |
movi_c/slotcontrast/best.ckpt |
SlotContrast baseline (discovery tables) | 36.8 |
movi_c/slotcontrast/best.live.ckpt |
SlotContrast, live copy read by the dynamics pipeline | 100.6 |
movi_c/dynamics/ocvp_act_isee_step30000.pt |
dynamics on iSEE slots (dynamics table) | 4.4 |
movi_c/dynamics/ocvp_act_slotcontrast_step30000.pt |
dynamics on SlotContrast slots (dynamics table) | 4.4 |
movi_c/dynamics/dynloc_isee_step30000.pt |
dynamics with position stream, iSEE (dynamics figure) | 4.4 |
movi_c/dynamics/dynloc_slotcontrast_step30000.pt |
dynamics with position stream, SlotContrast | 4.4 |
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support