2021-11-06 21:16:10,357 INFO    MainThread:4368 [wandb_setup.py:_flush():69] setting env: {}
2021-11-06 21:16:10,357 INFO    MainThread:4368 [wandb_setup.py:_flush():69] setting login settings: {}
2021-11-06 21:16:10,357 INFO    MainThread:4368 [wandb_init.py:_log_setup():348] Logging user logs to /home/leandro/codeparrot-small/wandb/run-20211106_211610-dtkf2u0m/logs/debug.log
2021-11-06 21:16:10,358 INFO    MainThread:4368 [wandb_init.py:_log_setup():349] Logging internal logs to /home/leandro/codeparrot-small/wandb/run-20211106_211610-dtkf2u0m/logs/debug-internal.log
2021-11-06 21:16:10,358 INFO    MainThread:4368 [wandb_init.py:init():381] calling init triggers
2021-11-06 21:16:10,358 INFO    MainThread:4368 [wandb_init.py:init():386] wandb.init called with sweep_config: {}
config: {'train_batch_size': 12, 'valid_batch_size': 12, 'weight_decay': 0.1, 'shuffle_buffer': 1000, 'learning_rate': 0.0005, 'lr_scheduler_type': 'cosine', 'num_warmup_steps': 2000, 'gradient_accumulation_steps': 1, 'gradient_checkpointing': False, 'max_train_steps': 150000, 'max_eval_steps': -1, 'seq_length': 1024, 'seed': 1, 'save_checkpoint_steps': 15000, 'backend': 'nccl', 'deepspeed_plugin': 'None', 'distributed_type': 'DistributedType.MULTI_GPU', 'num_processes': '16', 'process_index': '0', 'local_process_index': '0', 'device': 'cuda:0', 'use_fp16': 'True', 'initialized': 'True'}
2021-11-06 21:16:10,358 INFO    MainThread:4368 [wandb_init.py:init():430] starting backend
2021-11-06 21:16:10,358 INFO    MainThread:4368 [backend.py:_multiprocessing_setup():70] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2021-11-06 21:16:10,378 INFO    MainThread:4368 [backend.py:ensure_launched():135] starting backend process...
2021-11-06 21:16:10,389 INFO    MainThread:4368 [backend.py:ensure_launched():139] started backend process with pid: 4634
2021-11-06 21:16:10,391 INFO    MainThread:4368 [wandb_init.py:init():435] backend started and connected
2021-11-06 21:16:10,396 INFO    MainThread:4368 [wandb_init.py:init():494] updated telemetry
2021-11-06 21:16:10,397 INFO    MainThread:4368 [wandb_init.py:init():517] communicating current version
2021-11-06 21:16:10,957 INFO    MainThread:4368 [wandb_init.py:init():522] got version response upgrade_message: "wandb version 0.12.6 is available!  To upgrade, please run:\n $ pip install wandb --upgrade"

2021-11-06 21:16:10,957 INFO    MainThread:4368 [wandb_init.py:init():530] communicating run to backend with 30 second timeout
2021-11-06 21:16:11,044 INFO    MainThread:4368 [wandb_init.py:init():557] starting run threads in backend
2021-11-06 21:16:12,320 INFO    MainThread:4368 [wandb_run.py:_console_start():1605] atexit reg
2021-11-06 21:16:12,320 INFO    MainThread:4368 [wandb_run.py:_redirect():1479] redirect: SettingsConsole.REDIRECT
2021-11-06 21:16:12,320 INFO    MainThread:4368 [wandb_run.py:_redirect():1484] Redirecting console.
2021-11-06 21:16:12,322 INFO    MainThread:4368 [wandb_run.py:_redirect():1540] Redirects installed.
2021-11-06 21:16:12,323 INFO    MainThread:4368 [wandb_init.py:init():582] run started, returning control to user process