allex-eef-N-h16 β€” arm N (base)

ALLEX μ ˆλŒ€-EEF 50D RLDX-1 mid-train, flow-matching 손싀 ν•˜λ‚˜λΏ. CogAlign μ—†μŒ, ν† ν¬λ‚˜μ΄μ € latent μ—†μŒ. arm AB 의 λŒ€μ‘°κ΅°μ΄λ‹€.

ꡬ쑰 β€” μ²΄ν¬ν¬μΈνŠΈλ§ˆλ‹€ 폴더가 λ‚˜λ‰˜μ–΄ μžˆλ‹€

경둜 step λΉ„κ³ 
checkpoint-30000/ 30,000 쀑간
checkpoint-50000/ 50,000 쀑간
checkpoint-60000/ 60,000 μ™„μ£Ό (train_loss 0.0282)
from huggingface_hub import snapshot_download
p = snapshot_download("jungwook2358/allex-eef-N-h16",
                      allow_patterns="checkpoint-60000/*")

곡톡 μ„€μ • (두 arm 동일)

  • base: RLWRLD/RLDX-1-PT-IMG
  • action: μ ˆλŒ€ EEF 50D = left_wrist_wrt_base 9 + right_wrist_wrt_base 9
    • left_hand_joints 15 + right_hand_joints 15 + neck_joints 2 (waist μ œμ™Έ, μƒλŒ€ν™” μ—†μŒ) μˆœμ„œλŠ” Stage-1 ν† ν¬λ‚˜μ΄μ €μ™€ Stage-2 RLDX κ°€ λ™μΌν•˜λ‹€ (left β†’ right β†’ neck).
  • horizon 16, embodiment_tag GENERAL_EMBODIMENT, --override-pretraining-statistics
  • μ •κ·œν™” q99: 2*(x-q01)/(q99-q01)-1 ν›„ clamp(-1,1). 3μ†ŒμŠ€ 병합톡계(q01=min-of-q01, q99=max-of-q99)
  • κΈ€λ‘œλ²Œ 배치 256 (2 GPU Γ— per-device 128, accum 1), lr 1e-4, 60,000 μŠ€ν…
  • 카메라 2λŒ€ (ego left/right), video_length 1, state_dropout 0.3
  • VLM 동결: tune_llm=False, tune_visual=False, tune_top_llm_layers=0
  • 데이터: robot allex v1v6 / human hmd,umi v1v12 LPF β€” λΉ„μœ¨ 0.50 : 0.25 : 0.25

각 checkpoint-*/ μ•ˆμ— κ·Έ 체크포인트 고유의 μ •κ·œν™” 톡계가 λ“€μ–΄ μžˆλ‹€: experiment_cfg/dataset_statistics.json, processor/statistics.json. λ‹€λ₯Έ 체크포인트의 톡계λ₯Ό κ°–λ‹€ μ“°μ§€ 말 것.

좔둠에 쓰이지 μ•ŠλŠ” ν•™μŠ΅ μƒνƒœ(global_step*/, optimizer.pt, scheduler.pt, rng_state_*.pth, training_args.bin, zero_to_fp32.py)λŠ” μ˜¬λ¦¬μ§€ μ•Šμ•˜λ‹€.

μ½”λ“œ

  • Stage-2: jungwook235/RLDX-1-egopi branch feat/allex-eef-h16-midtrain
  • μŠ€ν¬λ¦½νŠΈΒ·λ¬Έμ„œ: jungwook235/action-tokenizer gpu26-server/submit/allex_eef_*, docs/allex_eef_midtrain/README.md

⚠️ action_dim 이 48 이 μ•„λ‹ˆλΌ 50 이닀. κΈ°μ‘΄ allex 런(쑰인트 48D, waist 포함)κ³Ό λ‹€λ₯Έ κ³„λ³΄μ΄λ―€λ‘œ 48D 둜 λ‘œλ“œν•˜λ©΄ μ•ˆ λœλ‹€.

Downloads last month

-

Downloads are not tracked for this model. How to track
Video Preview
loading