wandb/run-20220119_161158-274aad95/logs/debug.log

2022-01-19 16:11:58,981 INFO    MainThread:1271442 [wandb_setup.py:_flush():71] setting env: {}
2022-01-19 16:11:58,981 INFO    MainThread:1271442 [wandb_setup.py:_flush():71] setting login settings: {}
2022-01-19 16:11:58,981 INFO    MainThread:1271442 [wandb_init.py:_log_setup():371] Logging user logs to /data/roberta-base-ncc-512/wandb/run-20220119_161158-274aad95/logs/debug.log
2022-01-19 16:11:58,981 INFO    MainThread:1271442 [wandb_init.py:_log_setup():372] Logging internal logs to /data/roberta-base-ncc-512/wandb/run-20220119_161158-274aad95/logs/debug-internal.log
2022-01-19 16:11:58,981 INFO    MainThread:1271442 [wandb_init.py:init():404] calling init triggers
2022-01-19 16:11:58,981 INFO    MainThread:1271442 [wandb_init.py:init():409] wandb.init called with sweep_config: {}
config: {}
2022-01-19 16:11:58,981 INFO    MainThread:1271442 [wandb_init.py:init():460] starting backend
2022-01-19 16:11:58,981 INFO    MainThread:1271442 [backend.py:_multiprocessing_setup():99] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2022-01-19 16:11:59,112 INFO    MainThread:1271442 [backend.py:ensure_launched():216] starting backend process...
2022-01-19 16:11:59,241 INFO    MainThread:1271442 [backend.py:ensure_launched():221] started backend process with pid: 1666268
2022-01-19 16:11:59,243 INFO    MainThread:1271442 [wandb_init.py:init():469] backend started and connected
2022-01-19 16:11:59,257 INFO    MainThread:1271442 [wandb_init.py:init():533] updated telemetry
2022-01-19 16:11:59,616 INFO    MainThread:1271442 [wandb_init.py:init():563] communicating current version
2022-01-19 16:12:00,207 INFO    MainThread:1271442 [wandb_init.py:init():568] got version response 
2022-01-19 16:12:00,207 INFO    MainThread:1271442 [wandb_init.py:init():578] communicating run to backend with 30 second timeout
2022-01-19 16:12:00,401 INFO    MainThread:1271442 [wandb_init.py:init():606] starting run threads in backend
2022-01-19 16:12:02,729 INFO    MainThread:1271442 [wandb_run.py:_console_start():1810] atexit reg
2022-01-19 16:12:02,730 INFO    MainThread:1271442 [wandb_run.py:_redirect():1684] redirect: SettingsConsole.REDIRECT
2022-01-19 16:12:02,731 INFO    MainThread:1271442 [wandb_run.py:_redirect():1689] Redirecting console.
2022-01-19 16:12:02,733 INFO    MainThread:1271442 [wandb_run.py:_redirect():1745] Redirects installed.
2022-01-19 16:12:02,733 INFO    MainThread:1271442 [wandb_init.py:init():633] run started, returning control to user process
2022-01-19 16:12:02,734 INFO    MainThread:1271442 [wandb_run.py:_config_callback():956] config_cb None None {'output_dir': './', 'overwrite_output_dir': True, 'do_train': True, 'do_eval': True, 'per_device_train_batch_size': 46, 'per_device_eval_batch_size': 46, 'learning_rate': 0.0006, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.98, 'adam_epsilon': 1e-06, 'adafactor': False, 'num_train_epochs': 3.0, 'warmup_steps': 1000, 'logging_steps': 1000, 'save_steps': 1000, 'eval_steps': 1000, 'seed': 42, 'push_to_hub': True, 'hub_model_id': None, 'hub_token': None}
2022-01-19 16:12:02,734 INFO    MainThread:1271442 [wandb_run.py:_config_callback():956] config_cb None None {'model_name_or_path': './', 'model_type': 'roberta', 'config_name': './', 'tokenizer_name': './', 'cache_dir': None, 'use_fast_tokenizer': True, 'dtype': 'bfloat16'}
2022-01-19 16:12:02,735 INFO    MainThread:1271442 [wandb_run.py:_config_callback():956] config_cb None None {'dataset_name': 'NbAiLab/NCC', 'dataset_config_name': None, 'train_file': None, 'validation_file': None, 'train_ref_file': None, 'validation_ref_file': None, 'overwrite_cache': False, 'validation_split_percentage': 5, 'max_seq_length': 512, 'preprocessing_num_workers': None, 'mlm_probability': 0.15, 'pad_to_max_length': True, 'line_by_line': False}