| 2025-08-22 17:55:44,851 INFO MainThread:4004464 [wandb_setup.py:_flush():80] Current SDK version is 0.21.0 | |
| 2025-08-22 17:55:44,851 INFO MainThread:4004464 [wandb_setup.py:_flush():80] Configure stats pid to 4004464 | |
| 2025-08-22 17:55:44,851 INFO MainThread:4004464 [wandb_setup.py:_flush():80] Loading settings from /home/ubuntu/.config/wandb/settings | |
| 2025-08-22 17:55:44,852 INFO MainThread:4004464 [wandb_setup.py:_flush():80] Loading settings from /lambda/nfs/jianwen-us-midwest-1/tulab/ruisen/myvla/wandb/settings | |
| 2025-08-22 17:55:44,852 INFO MainThread:4004464 [wandb_setup.py:_flush():80] Loading settings from environment variables | |
| 2025-08-22 17:55:44,852 INFO MainThread:4004464 [wandb_init.py:setup_run_log_directory():703] Logging user logs to myvla_exp/bl_multiview_depth_set_table/wandb/run-20250822_175544-mg58khw0/logs/debug.log | |
| 2025-08-22 17:55:44,852 INFO MainThread:4004464 [wandb_init.py:setup_run_log_directory():704] Logging internal logs to myvla_exp/bl_multiview_depth_set_table/wandb/run-20250822_175544-mg58khw0/logs/debug-internal.log | |
| 2025-08-22 17:55:44,852 INFO MainThread:4004464 [wandb_init.py:init():830] calling init triggers | |
| 2025-08-22 17:55:44,852 INFO MainThread:4004464 [wandb_init.py:init():835] wandb.init called with sweep_config: {} | |
| config: {'vla': {'type': 'myvla-qwen-224px+mx-mshab', 'vla_id': 'myvla-qwen-224px+mx-mshab', 'base_vlm': 'prism-qwen25-extra-dinosiglip-224px+0_5b', 'freeze_vision_backbone': True, 'freeze_llm_backbone': False, 'unfreeze_last_llm_layer': False, 'data_mix': 'bridge', 'shuffle_buffer_size': 256000, 'epochs': 10, 'max_steps': None, 'save_every_n_steps': 25000, 'expected_world_size': 8, 'global_batch_size': 512, 'per_device_batch_size': 8, 'learning_rate': 2e-05, 'weight_decay': 0.0, 'max_grad_norm': 1.0, 'lr_scheduler_type': 'constant', 'warmup_ratio': 0.0, 'train_strategy': 'fsdp-full-shard', 'action_tokenizer': 'extra_action_tokenizer', 'image_sequence_len': 4, 'use_wrist_image': True, 'compress_history': False, 'use_flow_matching': False, 'action_chunk_size': 8, 'enable_gradient_checkpointing': True, 'enable_mixed_precision_training': True, 'reduce_in_full_precision': True, 'image_window_size': 1}, 'model_type': 'my_vla_qwen', 'data_root_dir': '/home/ubuntu/jianwen-us-midwest-1/tulab/ruisen/.new_maniskill_data', 'run_root_dir': 'myvla_exp', 'pretrained_checkpoint': 'Stanford-ILIAD/prism-qwen25-extra-dinosiglip-224px-0_5b', 'is_resume': False, 'resume_step': None, 'resume_epoch': None, 'run_id': 'bl_multiview_depth_set_table', 'run_id_note': None, 'save_interval': 1000, 'image_aug': False, 'seed': 7, 'hf_token': '.hf_token', 'trackers': ['jsonl', 'wandb'], 'wandb_project': 'mshab_vla', 'wandb_entity': 'traysen879-uc-san-diego', 'global_pose': False, 'is_grasped': False, 'qpos': False, 'depth': False, 'segmentation': False, '_wandb': {}} | |
| 2025-08-22 17:55:44,852 INFO MainThread:4004464 [wandb_init.py:init():871] starting backend | |
| 2025-08-22 17:55:45,099 INFO MainThread:4004464 [wandb_init.py:init():874] sending inform_init request | |
| 2025-08-22 17:55:45,108 INFO MainThread:4004464 [wandb_init.py:init():882] backend started and connected | |
| 2025-08-22 17:55:45,114 INFO MainThread:4004464 [wandb_init.py:init():953] updated telemetry | |
| 2025-08-22 17:55:45,150 INFO MainThread:4004464 [wandb_init.py:init():977] communicating run to backend with 90.0 second timeout | |
| 2025-08-22 17:55:45,586 INFO MainThread:4004464 [wandb_init.py:init():1029] starting run threads in backend | |
| 2025-08-22 17:55:46,161 INFO MainThread:4004464 [wandb_run.py:_console_start():2458] atexit reg | |
| 2025-08-22 17:55:46,161 INFO MainThread:4004464 [wandb_run.py:_redirect():2306] redirect: wrap_raw | |
| 2025-08-22 17:55:46,163 INFO MainThread:4004464 [wandb_run.py:_redirect():2375] Wrapping output streams. | |
| 2025-08-22 17:55:46,163 INFO MainThread:4004464 [wandb_run.py:_redirect():2398] Redirects installed. | |
| 2025-08-22 17:55:46,173 INFO MainThread:4004464 [wandb_init.py:init():1075] run started, returning control to user process | |
| 2025-08-23 06:27:09,979 INFO MainThread:4004464 [wandb_run.py:_finish():2224] finishing run traysen879-uc-san-diego/mshab_vla/mg58khw0 | |
| 2025-08-23 06:27:09,980 INFO MainThread:4004464 [wandb_run.py:_atexit_cleanup():2423] got exitcode: 0 | |
| 2025-08-23 06:27:09,980 INFO MainThread:4004464 [wandb_run.py:_restore():2405] restore | |
| 2025-08-23 06:27:09,981 INFO MainThread:4004464 [wandb_run.py:_restore():2411] restore done | |
| 2025-08-23 06:27:10,444 INFO MainThread:4004464 [wandb_run.py:_footer_history_summary_info():3903] rendering history | |
| 2025-08-23 06:27:10,446 INFO MainThread:4004464 [wandb_run.py:_footer_history_summary_info():3935] rendering summary | |
| 2025-08-23 06:27:10,446 INFO MainThread:4004464 [wandb_run.py:_footer_sync_info():3864] logging synced files | |