kairos-posicao-bert-custom

README.md

@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [belisards/congretimbau](https://huggingface.co/belisards/congretimbau) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2121
-- Accuracy: 0.7823
-- F1: 0.7252
-- Recall: 0.7628
-- Precision: 0.7103
+- Loss: 0.1877
+- Accuracy: 0.7891
+- F1: 0.7273
+- Recall: 0.7564
+- Precision: 0.7128
 
 ## Model description
 
@@ -50,22 +50,19 @@ The following hyperparameters were used during training:
 - seed: 5151
 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 200
+- lr_scheduler_warmup_steps: 120
 - num_epochs: 18
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Recall | Precision |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:---------:|
-| 0.2495        | 1.0   | 35   | 0.3182          | 0.7143   | 0.5311 | 0.5380 | 0.5711    |
-| 0.2596        | 2.0   | 70   | 0.2572          | 0.4911   | 0.4818 | 0.5557 | 0.5448    |
-| 0.2321        | 3.0   | 105  | 0.2390          | 0.7232   | 0.6754 | 0.7011 | 0.6681    |
-| 0.1769        | 4.0   | 140  | 0.2265          | 0.7054   | 0.6773 | 0.7339 | 0.6816    |
-| 0.1614        | 5.0   | 175  | 0.2461          | 0.7054   | 0.6735 | 0.7227 | 0.6745    |
-| 0.1027        | 6.0   | 210  | 0.2762          | 0.8125   | 0.7764 | 0.8062 | 0.7621    |
-| 0.0832        | 7.0   | 245  | 0.3463          | 0.8036   | 0.7441 | 0.7441 | 0.7441    |
-| 0.0354        | 8.0   | 280  | 0.6084          | 0.8214   | 0.7673 | 0.7673 | 0.7673    |
-| 0.0068        | 9.0   | 315  | 0.6917          | 0.8214   | 0.7673 | 0.7673 | 0.7673    |
+| 0.29          | 1.0   | 35   | 0.2717          | 0.5625   | 0.5209 | 0.5478 | 0.5371    |
+| 0.2615        | 2.0   | 70   | 0.2353          | 0.5357   | 0.5344 | 0.6643 | 0.6468    |
+| 0.2189        | 3.0   | 105  | 0.1945          | 0.8036   | 0.7637 | 0.7889 | 0.7506    |
+| 0.1579        | 4.0   | 140  | 0.1931          | 0.7857   | 0.7375 | 0.7545 | 0.7273    |
+| 0.1078        | 5.0   | 175  | 0.2402          | 0.8036   | 0.7496 | 0.7553 | 0.7447    |
+| 0.0596        | 6.0   | 210  | 0.2657          | 0.7946   | 0.7591 | 0.7941 | 0.7458    |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:adc10c8d645bee126d09306555285915adcb97bb437b44345f7c80ecd2c1a28e
+oid sha256:b70a7376911fb4d184b10a3112f8c146f678d9484ef473b4cbcda8e6aef7008d
 size 1337640872

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e4f620a73748271896e4fc0ac7cc041eb11591c0b71449b2bdfbd32dd7578da0
+oid sha256:e9e08b99bfbe1492e28077fa1376395767ae2fc288cdce2b4c42ab789a66d07c
 size 5304

wandb/debug-internal.log

@@ -1,43 +1,43 @@
-{"time":"2024-12-11T04:40:25.443599352Z","level":"INFO","msg":"using version","core version":"0.19.0"}
-{"time":"2024-12-11T04:40:25.443627756Z","level":"INFO","msg":"created symlink","path":"/content/wandb/run-20241211_044025-u0sz1qfs/logs/debug-core.log"}
-{"time":"2024-12-11T04:40:25.546102875Z","level":"INFO","msg":"created new stream","id":"u0sz1qfs"}
-{"time":"2024-12-11T04:40:25.546146917Z","level":"INFO","msg":"stream: started","id":"u0sz1qfs"}
-{"time":"2024-12-11T04:40:25.546175325Z","level":"INFO","msg":"writer: Do: started","stream_id":"u0sz1qfs"}
-{"time":"2024-12-11T04:40:25.546186965Z","level":"INFO","msg":"sender: started","stream_id":"u0sz1qfs"}
-{"time":"2024-12-11T04:40:25.546286214Z","level":"INFO","msg":"handler: started","stream_id":"u0sz1qfs"}
-{"time":"2024-12-11T04:40:26.467975256Z","level":"INFO","msg":"Starting system monitor"}
-{"time":"2024-12-11T04:40:27.051552456Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:40:27.051592092Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:40:27.051597256Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:40:27.051600962Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:40:27.051604422Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:40:27.051607914Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:40:27.642186144Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:40:27.68243498Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:47:04.149554653Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:47:04.154179613Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:47:05.550529502Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:47:05.554619433Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:47:05.555156528Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:47:05.560780066Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:47:05.630237363Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:47:05.634313676Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:47:05.636725169Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:47:05.640826001Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:47:08.840358614Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:47:08.880549683Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:47:08.880579644Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:47:08.880587559Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:47:08.88059563Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:47:08.880602318Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:47:08.880608383Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-11T04:47:08.880614775Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-11T04:47:08.88064159Z","level":"INFO","msg":"Stopping system monitor"}
-{"time":"2024-12-11T04:47:08.881345726Z","level":"INFO","msg":"Stopped system monitor"}
-{"time":"2024-12-11T04:47:09.142328584Z","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
-{"time":"2024-12-11T04:47:09.199989792Z","level":"INFO","msg":"handler: operation stats","stats":{}}
-{"time":"2024-12-11T04:47:10.21454415Z","level":"INFO","msg":"stream: closing","id":"u0sz1qfs"}
-{"time":"2024-12-11T04:47:10.214573179Z","level":"INFO","msg":"handler: closed","stream_id":"u0sz1qfs"}
-{"time":"2024-12-11T04:47:10.214582142Z","level":"INFO","msg":"writer: Close: closed","stream_id":"u0sz1qfs"}
-{"time":"2024-12-11T04:47:10.214607109Z","level":"INFO","msg":"sender: closed","stream_id":"u0sz1qfs"}
-{"time":"2024-12-11T04:47:10.214642444Z","level":"INFO","msg":"stream: closed","id":"u0sz1qfs"}
+{"time":"2024-12-11T04:50:47.420166727Z","level":"INFO","msg":"using version","core version":"0.19.0"}
+{"time":"2024-12-11T04:50:47.420188806Z","level":"INFO","msg":"created symlink","path":"/content/wandb/run-20241211_045047-iixgzowh/logs/debug-core.log"}
+{"time":"2024-12-11T04:50:47.522675109Z","level":"INFO","msg":"created new stream","id":"iixgzowh"}
+{"time":"2024-12-11T04:50:47.522707089Z","level":"INFO","msg":"stream: started","id":"iixgzowh"}
+{"time":"2024-12-11T04:50:47.522760019Z","level":"INFO","msg":"handler: started","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:50:47.522741946Z","level":"INFO","msg":"writer: Do: started","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:50:47.522818391Z","level":"INFO","msg":"sender: started","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:50:48.347627641Z","level":"INFO","msg":"Starting system monitor"}
+{"time":"2024-12-11T04:50:48.997536401Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:50:48.997570241Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:50:48.997576117Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:50:48.997579979Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:50:48.997583404Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:50:48.997586701Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:50:49.577041341Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:50:49.618452446Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:45.869880542Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:45.874900215Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:47.366091729Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:47.370222766Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:47.370839646Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:47.376849547Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:47.451397371Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:47.456005601Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:47.4588096Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:47.464120605Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:50.562786625Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:50.603587514Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:50.603613208Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:50.603618039Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:50.60362293Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:50.603633564Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:50.603637242Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:50.603640545Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:50.603661142Z","level":"INFO","msg":"Stopping system monitor"}
+{"time":"2024-12-11T04:55:50.604205943Z","level":"INFO","msg":"Stopped system monitor"}
+{"time":"2024-12-11T04:55:50.862348476Z","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
+{"time":"2024-12-11T04:55:50.91175051Z","level":"INFO","msg":"handler: operation stats","stats":{}}
+{"time":"2024-12-11T04:55:51.925784605Z","level":"INFO","msg":"stream: closing","id":"iixgzowh"}
+{"time":"2024-12-11T04:55:51.925811603Z","level":"INFO","msg":"handler: closed","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:55:51.92582357Z","level":"INFO","msg":"writer: Close: closed","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:55:51.925832625Z","level":"INFO","msg":"sender: closed","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:55:51.925904519Z","level":"INFO","msg":"stream: closed","id":"iixgzowh"}

wandb/debug.log

@@ -1,76 +1,76 @@
-2024-12-11 04:40:25,437 INFO    MainThread:5188 [wandb_setup.py:_flush():68] Current SDK version is 0.19.0
-2024-12-11 04:40:25,437 INFO    MainThread:5188 [wandb_setup.py:_flush():68] Configure stats pid to 5188
-2024-12-11 04:40:25,437 INFO    MainThread:5188 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings
-2024-12-11 04:40:25,437 INFO    MainThread:5188 [wandb_setup.py:_flush():68] Loading settings from /content/wandb/settings
-2024-12-11 04:40:25,437 INFO    MainThread:5188 [wandb_setup.py:_flush():68] Loading settings from environment variables
-2024-12-11 04:40:25,437 INFO    MainThread:5188 [wandb_init.py:_log_setup():528] Logging user logs to /content/wandb/run-20241211_044025-u0sz1qfs/logs/debug.log
-2024-12-11 04:40:25,437 INFO    MainThread:5188 [wandb_init.py:_log_setup():529] Logging internal logs to /content/wandb/run-20241211_044025-u0sz1qfs/logs/debug-internal.log
-2024-12-11 04:40:25,437 INFO    MainThread:5188 [wandb_init.py:_jupyter_setup():474] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x7ca2a037bd30>
-2024-12-11 04:40:25,438 INFO    MainThread:5188 [wandb_init.py:init():639] calling init triggers
-2024-12-11 04:40:25,438 INFO    MainThread:5188 [wandb_init.py:init():645] wandb.init called with sweep_config: {}
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_setup.py:_flush():68] Current SDK version is 0.19.0
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_setup.py:_flush():68] Configure stats pid to 8104
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_setup.py:_flush():68] Loading settings from /content/wandb/settings
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_setup.py:_flush():68] Loading settings from environment variables
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_init.py:_log_setup():528] Logging user logs to /content/wandb/run-20241211_045047-iixgzowh/logs/debug.log
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_init.py:_log_setup():529] Logging internal logs to /content/wandb/run-20241211_045047-iixgzowh/logs/debug-internal.log
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_init.py:_jupyter_setup():474] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x79e4275fb3d0>
+2024-12-11 04:50:47,416 INFO    MainThread:8104 [wandb_init.py:init():639] calling init triggers
+2024-12-11 04:50:47,416 INFO    MainThread:8104 [wandb_init.py:init():645] wandb.init called with sweep_config: {}
 config: {}
-2024-12-11 04:40:25,438 INFO    MainThread:5188 [wandb_init.py:init():688] starting backend
-2024-12-11 04:40:25,438 INFO    MainThread:5188 [wandb_init.py:init():692] sending inform_init request
-2024-12-11 04:40:25,440 INFO    MainThread:5188 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
-2024-12-11 04:40:25,441 INFO    MainThread:5188 [wandb_init.py:init():705] backend started and connected
-2024-12-11 04:40:25,449 INFO    MainThread:5188 [wandb_run.py:_label_probe_notebook():1327] probe notebook
-2024-12-11 04:40:26,283 INFO    MainThread:5188 [wandb_init.py:init():798] updated telemetry
-2024-12-11 04:40:26,284 INFO    MainThread:5188 [wandb_init.py:init():830] communicating run to backend with 90.0 second timeout
-2024-12-11 04:40:26,461 INFO    MainThread:5188 [wandb_init.py:init():882] starting run threads in backend
-2024-12-11 04:40:27,011 INFO    MainThread:5188 [wandb_run.py:_console_start():2443] atexit reg
-2024-12-11 04:40:27,011 INFO    MainThread:5188 [wandb_run.py:_redirect():2293] redirect: wrap_raw
-2024-12-11 04:40:27,011 INFO    MainThread:5188 [wandb_run.py:_redirect():2358] Wrapping output streams.
-2024-12-11 04:40:27,011 INFO    MainThread:5188 [wandb_run.py:_redirect():2383] Redirects installed.
-2024-12-11 04:40:27,013 INFO    MainThread:5188 [wandb_init.py:init():925] run started, returning control to user process
-2024-12-11 04:40:27,017 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:40:27,017 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:40:27,023 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:40:27,023 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:40:27,024 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:40:27,032 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:40:27,033 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:40:27,034 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:40:27,040 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:40:27,641 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:40:27,641 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:40:27,646 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:40:27,998 INFO    MainThread:5188 [wandb_run.py:_config_callback():1375] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['BertForMaskedLM'], 'finetuning_task': None, 'id2label': {0: '0', 1: '1'}, 'label2id': {'0': 0, '1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'belisards/congretimbau', '_attn_implementation_autoset': True, 'transformers_version': '4.47.0', 'directionality': 'bidi', 'model_type': 'bert', 'output_past': True, 'pooler_fc_size': 768, 'pooler_num_attention_heads': 12, 'pooler_num_fc_layers': 3, 'pooler_size_per_head': 128, 'pooler_type': 'first_token_transform', 'vocab_size': 29794, 'hidden_size': 1024, 'num_hidden_layers': 24, 'num_attention_heads': 16, 'hidden_act': 'gelu', 'intermediate_size': 4096, 'hidden_dropout_prob': 0.05, 'attention_probs_dropout_prob': 0.05, 'max_position_embeddings': 512, 'type_vocab_size': 2, 'initializer_range': 0.02, 'layer_norm_eps': 1e-12, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '.', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 32, 'per_device_eval_batch_size': 32, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 1e-05, 'weight_decay': 0.02, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 18, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 200, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Dec11_04-40-27_fd55a770be24', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 204, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 5151, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 102, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': 'm2-congretimbau_tunado', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'f1', 'greater_is_better': True, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False}
-2024-12-11 04:40:28,001 INFO    MainThread:5188 [wandb_config.py:__setitem__():154] config set model/num_parameters = 334398466 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7ca227e6b3a0>>
-2024-12-11 04:40:28,002 INFO    MainThread:5188 [wandb_run.py:_config_callback():1375] config_cb model/num_parameters 334398466 None
-2024-12-11 04:47:04,148 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:47:04,149 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:47:04,153 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:47:05,550 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:47:05,550 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:47:05,554 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:47:05,554 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:47:05,554 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:47:05,560 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:47:05,629 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:47:05,629 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:47:05,633 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:47:05,636 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:47:05,636 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:47:05,640 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:47:08,839 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:47:08,840 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:47:08,847 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:47:08,848 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:47:08,848 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:47:08,854 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:47:08,867 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:47:08,867 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:47:08,871 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:47:08,872 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:47:08,872 INFO    MainThread:5188 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-11 04:47:08,876 INFO    MainThread:5188 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-11 04:47:08,877 INFO    MainThread:5188 [wandb_run.py:_finish():2169] finishing run adrianobf/AzMina-M2/u0sz1qfs
-2024-12-11 04:47:08,878 INFO    MainThread:5188 [jupyter.py:save_history():459] not saving jupyter history
-2024-12-11 04:47:08,878 INFO    MainThread:5188 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-11 04:47:08,878 INFO    MainThread:5188 [wandb_init.py:_jupyter_teardown():456] cleaning up jupyter logic
-2024-12-11 04:47:08,878 INFO    MainThread:5188 [wandb_run.py:_atexit_cleanup():2408] got exitcode: 0
-2024-12-11 04:47:08,878 INFO    MainThread:5188 [wandb_run.py:_restore():2390] restore
-2024-12-11 04:47:08,878 INFO    MainThread:5188 [wandb_run.py:_restore():2396] restore done
-2024-12-11 04:47:10,202 INFO    MainThread:5188 [wandb_run.py:_footer_history_summary_info():3951] rendering history
-2024-12-11 04:47:10,203 INFO    MainThread:5188 [wandb_run.py:_footer_history_summary_info():3983] rendering summary
-2024-12-11 04:47:10,211 INFO    MainThread:5188 [wandb_run.py:_footer_sync_info():3912] logging synced files
+2024-12-11 04:50:47,416 INFO    MainThread:8104 [wandb_init.py:init():688] starting backend
+2024-12-11 04:50:47,416 INFO    MainThread:8104 [wandb_init.py:init():692] sending inform_init request
+2024-12-11 04:50:47,418 INFO    MainThread:8104 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2024-12-11 04:50:47,418 INFO    MainThread:8104 [wandb_init.py:init():705] backend started and connected
+2024-12-11 04:50:47,425 INFO    MainThread:8104 [wandb_run.py:_label_probe_notebook():1327] probe notebook
+2024-12-11 04:50:48,259 INFO    MainThread:8104 [wandb_init.py:init():798] updated telemetry
+2024-12-11 04:50:48,259 INFO    MainThread:8104 [wandb_init.py:init():830] communicating run to backend with 90.0 second timeout
+2024-12-11 04:50:48,341 INFO    MainThread:8104 [wandb_init.py:init():882] starting run threads in backend
+2024-12-11 04:50:48,957 INFO    MainThread:8104 [wandb_run.py:_console_start():2443] atexit reg
+2024-12-11 04:50:48,957 INFO    MainThread:8104 [wandb_run.py:_redirect():2293] redirect: wrap_raw
+2024-12-11 04:50:48,957 INFO    MainThread:8104 [wandb_run.py:_redirect():2358] Wrapping output streams.
+2024-12-11 04:50:48,958 INFO    MainThread:8104 [wandb_run.py:_redirect():2383] Redirects installed.
+2024-12-11 04:50:48,959 INFO    MainThread:8104 [wandb_init.py:init():925] run started, returning control to user process
+2024-12-11 04:50:48,963 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:50:48,963 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:50:48,968 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:50:48,968 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:50:48,968 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:50:48,976 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:50:48,978 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:50:48,978 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:50:48,984 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:50:49,576 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:50:49,576 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:50:49,581 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:50:49,974 INFO    MainThread:8104 [wandb_run.py:_config_callback():1375] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['BertForMaskedLM'], 'finetuning_task': None, 'id2label': {0: '0', 1: '1'}, 'label2id': {'0': 0, '1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'belisards/congretimbau', '_attn_implementation_autoset': True, 'transformers_version': '4.47.0', 'directionality': 'bidi', 'model_type': 'bert', 'output_past': True, 'pooler_fc_size': 768, 'pooler_num_attention_heads': 12, 'pooler_num_fc_layers': 3, 'pooler_size_per_head': 128, 'pooler_type': 'first_token_transform', 'vocab_size': 29794, 'hidden_size': 1024, 'num_hidden_layers': 24, 'num_attention_heads': 16, 'hidden_act': 'gelu', 'intermediate_size': 4096, 'hidden_dropout_prob': 0.05, 'attention_probs_dropout_prob': 0.05, 'max_position_embeddings': 512, 'type_vocab_size': 2, 'initializer_range': 0.02, 'layer_norm_eps': 1e-12, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '.', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 32, 'per_device_eval_batch_size': 32, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 1e-05, 'weight_decay': 0.02, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 18, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 120, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Dec11_04-50-48_fd55a770be24', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 204, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 5151, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 102, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': 'm2-congretimbau_tunado', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'f1', 'greater_is_better': True, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False}
+2024-12-11 04:50:49,978 INFO    MainThread:8104 [wandb_config.py:__setitem__():154] config set model/num_parameters = 334398466 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x79e3ac5f6380>>
+2024-12-11 04:50:49,978 INFO    MainThread:8104 [wandb_run.py:_config_callback():1375] config_cb model/num_parameters 334398466 None
+2024-12-11 04:55:45,869 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:45,869 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:45,874 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:47,365 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:47,365 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:47,370 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:47,370 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:47,370 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:47,376 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:47,450 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:47,451 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:47,455 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:47,458 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:47,458 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:47,463 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:50,562 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:50,562 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:50,569 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:50,571 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:50,571 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:50,576 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:50,589 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:50,589 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:50,594 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:50,594 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:50,594 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:50,598 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:50,599 INFO    MainThread:8104 [wandb_run.py:_finish():2169] finishing run adrianobf/AzMina-M2/iixgzowh
+2024-12-11 04:55:50,599 INFO    MainThread:8104 [jupyter.py:save_history():459] not saving jupyter history
+2024-12-11 04:55:50,600 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:50,600 INFO    MainThread:8104 [wandb_init.py:_jupyter_teardown():456] cleaning up jupyter logic
+2024-12-11 04:55:50,600 INFO    MainThread:8104 [wandb_run.py:_atexit_cleanup():2408] got exitcode: 0
+2024-12-11 04:55:50,600 INFO    MainThread:8104 [wandb_run.py:_restore():2390] restore
+2024-12-11 04:55:50,600 INFO    MainThread:8104 [wandb_run.py:_restore():2396] restore done
+2024-12-11 04:55:51,914 INFO    MainThread:8104 [wandb_run.py:_footer_history_summary_info():3951] rendering history
+2024-12-11 04:55:51,915 INFO    MainThread:8104 [wandb_run.py:_footer_history_summary_info():3983] rendering summary
+2024-12-11 04:55:51,922 INFO    MainThread:8104 [wandb_run.py:_footer_sync_info():3912] logging synced files

wandb/run-20241211_044025-u0sz1qfs/logs/debug-core.log

@@ -7,3 +7,10 @@
 {"time":"2024-12-11T04:40:25.546156381Z","level":"INFO","msg":"handleInformInit: stream started","streamId":"u0sz1qfs","id":"127.0.0.1:52302"}
 {"time":"2024-12-11T04:47:10.214499707Z","level":"INFO","msg":"handleInformFinish: finish message received","streamId":"u0sz1qfs","id":"127.0.0.1:52302"}
 {"time":"2024-12-11T04:47:10.214649619Z","level":"INFO","msg":"handleInformFinish: stream closed","streamId":"u0sz1qfs","id":"127.0.0.1:52302"}
+{"time":"2024-12-11T04:50:20.33378767Z","level":"INFO","msg":"handleInformTeardown: server teardown initiated","id":"127.0.0.1:52302"}
+{"time":"2024-12-11T04:50:20.333847754Z","level":"INFO","msg":"handleInformTeardown: server shutdown complete","id":"127.0.0.1:52302"}
+{"time":"2024-12-11T04:50:20.333855802Z","level":"INFO","msg":"server is shutting down"}
+{"time":"2024-12-11T04:50:20.333883663Z","level":"INFO","msg":"connection: Close: initiating connection closure","id":"127.0.0.1:52302"}
+{"time":"2024-12-11T04:50:20.333987181Z","level":"INFO","msg":"connection: Close: connection successfully closed","id":"127.0.0.1:52302"}
+{"time":"2024-12-11T04:50:20.334014593Z","level":"INFO","msg":"connection: ManageConnectionData: connection closed","id":"127.0.0.1:52302"}
+{"time":"2024-12-11T04:50:20.334027619Z","level":"INFO","msg":"server is closed"}

wandb/run-20241211_045047-iixgzowh/files/config.yaml

@@ -0,0 +1,568 @@
+_attn_implementation_autoset:
+    value: true
+_name_or_path:
+    value: belisards/congretimbau
+_wandb:
+    value:
+        cli_version: 0.19.0
+        m:
+            - "1": train/grad_norm
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": train/global_step
+              "6":
+                - 3
+              "7": []
+            - "1": train/learning_rate
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/steps_per_second
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/recall
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/runtime
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/samples_per_second
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": train/loss
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": train/epoch
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/loss
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/accuracy
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/f1
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/precision
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+        python_version: 3.10.12
+        t:
+            "1":
+                - 1
+                - 2
+                - 3
+                - 5
+                - 11
+                - 12
+                - 41
+                - 49
+                - 51
+                - 53
+                - 55
+                - 71
+                - 98
+                - 100
+                - 105
+            "2":
+                - 1
+                - 2
+                - 3
+                - 5
+                - 11
+                - 12
+                - 41
+                - 49
+                - 51
+                - 53
+                - 55
+                - 71
+                - 98
+                - 100
+                - 105
+            "3":
+                - 2
+                - 7
+                - 13
+                - 19
+                - 23
+                - 55
+                - 62
+                - 66
+            "4": 3.10.12
+            "5": 0.19.0
+            "6": 4.47.0
+            "8":
+                - 1
+                - 5
+                - 12
+            "9":
+                "1": transformers_trainer
+            "12": 0.19.0
+            "13": linux-x86_64
+accelerator_config:
+    value:
+        dispatch_batches: null
+        even_batches: true
+        gradient_accumulation_kwargs: null
+        non_blocking: false
+        split_batches: false
+        use_seedable_sampler: true
+adafactor:
+    value: false
+adam_beta1:
+    value: 0.9
+adam_beta2:
+    value: 0.999
+adam_epsilon:
+    value: 1e-08
+add_cross_attention:
+    value: false
+architectures:
+    value:
+        - BertForMaskedLM
+attention_probs_dropout_prob:
+    value: 0.05
+auto_find_batch_size:
+    value: false
+average_tokens_across_devices:
+    value: false
+bad_words_ids:
+    value: null
+batch_eval_metrics:
+    value: false
+begin_suppress_tokens:
+    value: null
+bf16:
+    value: false
+bf16_full_eval:
+    value: false
+bos_token_id:
+    value: null
+chunk_size_feed_forward:
+    value: 0
+classifier_dropout:
+    value: null
+cross_attention_hidden_size:
+    value: null
+data_seed:
+    value: null
+dataloader_drop_last:
+    value: false
+dataloader_num_workers:
+    value: 0
+dataloader_persistent_workers:
+    value: false
+dataloader_pin_memory:
+    value: true
+dataloader_prefetch_factor:
+    value: null
+ddp_backend:
+    value: null
+ddp_broadcast_buffers:
+    value: null
+ddp_bucket_cap_mb:
+    value: null
+ddp_find_unused_parameters:
+    value: null
+ddp_timeout:
+    value: 1800
+debug:
+    value: []
+decoder_start_token_id:
+    value: null
+deepspeed:
+    value: null
+directionality:
+    value: bidi
+disable_tqdm:
+    value: false
+dispatch_batches:
+    value: null
+diversity_penalty:
+    value: 0
+do_eval:
+    value: true
+do_predict:
+    value: false
+do_sample:
+    value: false
+do_train:
+    value: false
+early_stopping:
+    value: false
+encoder_no_repeat_ngram_size:
+    value: 0
+eos_token_id:
+    value: null
+eval_accumulation_steps:
+    value: null
+eval_delay:
+    value: 0
+eval_do_concat_batches:
+    value: true
+eval_on_start:
+    value: false
+eval_steps:
+    value: 102
+eval_strategy:
+    value: epoch
+eval_use_gather_object:
+    value: false
+evaluation_strategy:
+    value: null
+exponential_decay_length_penalty:
+    value: null
+finetuning_task:
+    value: null
+forced_bos_token_id:
+    value: null
+forced_eos_token_id:
+    value: null
+fp16:
+    value: false
+fp16_backend:
+    value: auto
+fp16_full_eval:
+    value: false
+fp16_opt_level:
+    value: O1
+fsdp:
+    value: []
+fsdp_config:
+    value:
+        min_num_params: 0
+        xla: false
+        xla_fsdp_grad_ckpt: false
+        xla_fsdp_v2: false
+fsdp_min_num_params:
+    value: 0
+fsdp_transformer_layer_cls_to_wrap:
+    value: null
+full_determinism:
+    value: false
+gradient_accumulation_steps:
+    value: 1
+gradient_checkpointing:
+    value: false
+gradient_checkpointing_kwargs:
+    value: null
+greater_is_better:
+    value: true
+group_by_length:
+    value: false
+half_precision_backend:
+    value: auto
+hidden_act:
+    value: gelu
+hidden_dropout_prob:
+    value: 0.05
+hidden_size:
+    value: 1024
+hub_always_push:
+    value: false
+hub_model_id:
+    value: null
+hub_private_repo:
+    value: null
+hub_strategy:
+    value: every_save
+hub_token:
+    value: <HUB_TOKEN>
+id2label:
+    value:
+        "0": "0"
+        "1": "1"
+ignore_data_skip:
+    value: false
+include_for_metrics:
+    value: []
+include_inputs_for_metrics:
+    value: false
+include_num_input_tokens_seen:
+    value: false
+include_tokens_per_second:
+    value: false
+initializer_range:
+    value: 0.02
+intermediate_size:
+    value: 4096
+is_decoder:
+    value: false
+is_encoder_decoder:
+    value: false
+jit_mode_eval:
+    value: false
+label_names:
+    value: null
+label_smoothing_factor:
+    value: 0
+label2id:
+    value:
+        "0": 0
+        "1": 1
+layer_norm_eps:
+    value: 1e-12
+learning_rate:
+    value: 1e-05
+length_column_name:
+    value: length
+length_penalty:
+    value: 1
+load_best_model_at_end:
+    value: true
+local_rank:
+    value: 0
+log_level:
+    value: passive
+log_level_replica:
+    value: warning
+log_on_each_node:
+    value: true
+logging_dir:
+    value: ./runs/Dec11_04-50-48_fd55a770be24
+logging_first_step:
+    value: false
+logging_nan_inf_filter:
+    value: true
+logging_steps:
+    value: 10
+logging_strategy:
+    value: steps
+lr_scheduler_type:
+    value: linear
+max_grad_norm:
+    value: 1
+max_length:
+    value: 20
+max_position_embeddings:
+    value: 512
+max_steps:
+    value: -1
+metric_for_best_model:
+    value: f1
+min_length:
+    value: 0
+model/num_parameters:
+    value: 334398466
+model_type:
+    value: bert
+mp_parameters:
+    value: ""
+neftune_noise_alpha:
+    value: null
+no_cuda:
+    value: false
+no_repeat_ngram_size:
+    value: 0
+num_attention_heads:
+    value: 16
+num_beam_groups:
+    value: 1
+num_beams:
+    value: 1
+num_hidden_layers:
+    value: 24
+num_return_sequences:
+    value: 1
+num_train_epochs:
+    value: 18
+optim:
+    value: adamw_torch
+optim_args:
+    value: null
+optim_target_modules:
+    value: null
+output_attentions:
+    value: false
+output_dir:
+    value: .
+output_hidden_states:
+    value: false
+output_past:
+    value: true
+output_scores:
+    value: false
+overwrite_output_dir:
+    value: false
+pad_token_id:
+    value: 0
+past_index:
+    value: -1
+per_device_eval_batch_size:
+    value: 32
+per_device_train_batch_size:
+    value: 32
+per_gpu_eval_batch_size:
+    value: null
+per_gpu_train_batch_size:
+    value: null
+pooler_fc_size:
+    value: 768
+pooler_num_attention_heads:
+    value: 12
+pooler_num_fc_layers:
+    value: 3
+pooler_size_per_head:
+    value: 128
+pooler_type:
+    value: first_token_transform
+position_embedding_type:
+    value: absolute
+prediction_loss_only:
+    value: false
+prefix:
+    value: null
+problem_type:
+    value: null
+push_to_hub:
+    value: false
+push_to_hub_model_id:
+    value: null
+push_to_hub_organization:
+    value: null
+push_to_hub_token:
+    value: <PUSH_TO_HUB_TOKEN>
+ray_scope:
+    value: last
+remove_invalid_values:
+    value: false
+remove_unused_columns:
+    value: true
+repetition_penalty:
+    value: 1
+report_to:
+    value:
+        - wandb
+restore_callback_states_from_checkpoint:
+    value: false
+resume_from_checkpoint:
+    value: null
+return_dict:
+    value: true
+return_dict_in_generate:
+    value: false
+run_name:
+    value: m2-congretimbau_tunado
+save_on_each_node:
+    value: false
+save_only_model:
+    value: false
+save_safetensors:
+    value: true
+save_steps:
+    value: 204
+save_strategy:
+    value: epoch
+save_total_limit:
+    value: 1
+seed:
+    value: 5151
+sep_token_id:
+    value: null
+skip_memory_metrics:
+    value: true
+split_batches:
+    value: null
+suppress_tokens:
+    value: null
+task_specific_params:
+    value: null
+temperature:
+    value: 1
+tf_legacy_loss:
+    value: false
+tf32:
+    value: null
+tie_encoder_decoder:
+    value: false
+tie_word_embeddings:
+    value: true
+tokenizer_class:
+    value: null
+top_k:
+    value: 50
+top_p:
+    value: 1
+torch_compile:
+    value: false
+torch_compile_backend:
+    value: null
+torch_compile_mode:
+    value: null
+torch_dtype:
+    value: float32
+torch_empty_cache_steps:
+    value: null
+torchdynamo:
+    value: null
+torchscript:
+    value: false
+tpu_metrics_debug:
+    value: false
+tpu_num_cores:
+    value: null
+transformers_version:
+    value: 4.47.0
+type_vocab_size:
+    value: 2
+typical_p:
+    value: 1
+use_bfloat16:
+    value: false
+use_cache:
+    value: true
+use_cpu:
+    value: false
+use_ipex:
+    value: false
+use_legacy_prediction_loop:
+    value: false
+use_liger_kernel:
+    value: false
+use_mps_device:
+    value: false
+vocab_size:
+    value: 29794
+warmup_ratio:
+    value: 0
+warmup_steps:
+    value: 120
+weight_decay:
+    value: 0.02

wandb/run-20241211_045047-iixgzowh/files/output.log

@@ -0,0 +1,8 @@
+              precision    recall  f1-score   support
+
+           0       0.90      0.82      0.86       114
+           1       0.52      0.70      0.60        33
+
+    accuracy                           0.79       147
+   macro avg       0.71      0.76      0.73       147
+weighted avg       0.82      0.79      0.80       147

wandb/run-20241211_045047-iixgzowh/files/requirements.txt

@@ -0,0 +1,578 @@
+multiprocess==0.70.16
+accelerate==1.2.0
+fsspec==2024.9.0
+wandb==0.19.0
+transformers==4.47.0
+evaluate==0.4.3
+dill==0.3.8
+tokenizers==0.21.0
+datasets==3.2.0
+xxhash==3.5.0
+google-colab==1.0.0
+termcolor==2.5.0
+numexpr==2.10.2
+duckdb==1.1.3
+slicer==0.0.8
+pandas-stubs==2.2.2.240909
+yarl==1.18.3
+jupyter-client==6.1.12
+umf==0.9.1
+aiohappyeyeballs==2.4.4
+tensorflow-io-gcs-filesystem==0.37.1
+nibabel==5.3.2
+google-api-python-client==2.151.0
+gensim==4.3.3
+plotnine==0.14.3
+stanio==0.5.1
+pyogrio==0.10.0
+nvidia-curand-cu12==10.3.7.77
+Bottleneck==1.4.2
+openpyxl==3.1.5
+audioread==3.0.1
+libcudf-cu12==24.10.1
+networkx==3.4.2
+cupy-cuda12x==12.2.0
+nx-cugraph-cu12==24.10.0
+aiosignal==1.3.1
+StrEnum==0.4.15
+jsonpickle==4.0.0
+google-cloud-firestore==2.19.0
+scipy==1.13.1
+colour==0.1.5
+pycparser==2.22
+cmake==3.30.5
+fastdownload==0.0.7
+google-cloud-functions==1.18.1
+imagesize==1.4.1
+imageio==2.36.1
+frozendict==2.4.6
+ndindex==1.9.2
+html5lib==1.1
+python-louvain==0.16
+Cython==3.0.11
+fastai==2.7.18
+cuda-python==12.2.1
+parsy==2.1
+smmap==5.0.1
+weasel==0.4.1
+pyasn1==0.6.1
+matplotlib==3.8.0
+immutabledict==4.2.1
+dopamine_rl==4.0.9
+uc-micro-py==1.0.3
+websocket-client==1.8.0
+anyio==3.7.1
+msgpack==1.1.0
+multitasking==0.0.11
+albucore==0.0.19
+scikit-image==0.24.0
+setproctitle==1.3.4
+marisa-trie==1.2.1
+nvidia-cuda-nvcc-cu12==12.6.85
+sphinxcontrib-qthelp==2.0.0
+tables==3.10.1
+kaggle==1.6.17
+google-cloud-core==2.4.1
+soupsieve==2.6
+opencv-contrib-python==4.10.0.84
+python-box==7.2.0
+fonttools==4.55.1
+Markdown==3.7
+googleapis-common-protos==1.66.0
+tensorflow-metadata==1.13.1
+google-auth-httplib2==0.2.0
+autograd==1.7.0
+pydantic_core==2.27.1
+pexpect==4.9.0
+tweepy==4.14.0
+pyshp==2.3.1
+sklearn-pandas==2.2.0
+toml==0.10.2
+pydotplus==2.0.2
+click==8.1.7
+optree==0.13.1
+catalogue==2.0.10
+google-api-core==2.19.2
+en-core-web-sm==3.7.1
+tensorflow-datasets==4.9.7
+pynvjitlink-cu12==0.4.0
+pytest==8.3.4
+portpicker==1.5.2
+dm-tree==0.1.8
+h5py==3.12.1
+pandas-gbq==0.24.0
+qdldl==0.1.7.post4
+partd==1.4.2
+wrapt==1.17.0
+blis==0.7.11
+textblob==0.17.1
+jupyterlab_widgets==3.0.13
+filelock==3.16.1
+oauth2client==4.1.3
+iniconfig==2.0.0
+notebook==6.5.5
+pydot==3.0.3
+tomli==2.2.1
+py4j==0.10.9.7
+langchain-text-splitters==0.3.2
+typer==0.15.0
+contourpy==1.3.1
+aiohttp==3.11.9
+langchain==0.3.9
+datascience==0.17.6
+etuples==0.3.9
+six==1.16.0
+tornado==6.3.3
+torchaudio==2.5.1+cu121
+httpcore==1.0.7
+importlib_metadata==8.5.0
+holoviews==1.20.0
+google-ai-generativelanguage==0.6.10
+osqp==0.6.7.post3
+pymc==5.18.2
+google-pasta==0.2.0
+py-cpuinfo==9.0.0
+colorcet==3.1.0
+blosc2==2.7.1
+nvidia-cuda-cupti-cu12==12.6.80
+colorlover==0.3.0
+pymystem3==0.2.0
+MarkupSafe==3.0.2
+astunparse==1.6.3
+google-cloud-bigquery==3.25.0
+opencv-python==4.10.0.84
+Flask==3.0.3
+fastjsonschema==2.21.1
+pylibcugraph-cu12==24.10.0
+google-cloud-datastore==2.20.1
+jaxlib==0.4.33
+rich==13.9.4
+widgetsnbextension==3.6.10
+vega-datasets==0.9.0
+natsort==8.4.0
+blinker==1.9.0
+statsmodels==0.14.4
+sniffio==1.3.1
+cymem==2.0.10
+threadpoolctl==3.5.0
+proto-plus==1.25.0
+httpimport==1.4.0
+matplotlib-inline==0.1.7
+ratelim==0.1.6
+python-utils==3.9.1
+prompt_toolkit==3.0.48
+gspread==6.0.2
+google-cloud-storage==2.8.0
+PyDrive==1.3.1
+tensorflow-probability==0.24.0
+xarray==2024.10.0
+eerepr==0.0.4
+murmurhash==1.0.11
+pylibcudf-cu12==24.10.1
+music21==9.3.0
+geographiclib==2.0
+smart-open==7.0.5
+pygit2==1.16.0
+more-itertools==10.5.0
+cycler==0.12.1
+idna==3.10
+h11==0.14.0
+ipython-genutils==0.2.0
+referencing==0.35.1
+GitPython==3.1.43
+sentencepiece==0.2.0
+CacheControl==0.14.1
+tf_keras==2.17.0
+annotated-types==0.7.0
+ecos==2.0.14
+geopandas==1.0.1
+jieba==0.42.1
+shapely==2.0.6
+ipyparallel==8.8.0
+pyOpenSSL==24.2.1
+pyarrow==17.0.0
+opencv-python-headless==4.10.0.84
+openai==1.54.5
+sentry-sdk==2.19.0
+pyarrow-hotfix==0.6
+gitdb==4.0.11
+prophet==1.1.6
+ipython-sql==0.5.0
+tf-slim==1.1.0
+PySocks==1.7.1
+imbalanced-learn==0.12.4
+mlxtend==0.23.3
+mkl==2025.0.1
+itsdangerous==2.2.0
+gast==0.6.0
+torchsummary==1.5.1
+urllib3==2.2.3
+earthengine-api==1.2.0
+jupyter-server==1.24.0
+webencodings==0.5.1
+seaborn==0.13.2
+SQLAlchemy==2.0.36
+pyerfa==2.0.1.5
+xarray-einstats==0.8.0
+jsonschema==4.23.0
+parso==0.8.4
+tensorflow-hub==0.16.1
+ipyfilechooser==0.6.0
+packaging==24.2
+param==2.1.1
+et_xmlfile==2.0.0
+kagglehub==0.3.4
+yfinance==0.2.50
+spacy==3.7.5
+imgaug==0.4.0
+sqlparse==0.5.2
+certifi==2024.8.30
+plotly==5.24.1
+pandas-datareader==0.10.0
+charset-normalizer==3.4.0
+cloudpathlib==0.20.0
+decorator==4.4.2
+prometheus_client==0.21.1
+google-auth==2.27.0
+pyzmq==24.0.1
+tzdata==2024.2
+scs==3.2.7
+types-pytz==2024.2.0.20241003
+db-dtypes==1.3.1
+chex==0.1.87
+spacy-loggers==1.0.5
+peewee==3.17.8
+nvidia-cuda-runtime-cu12==12.6.77
+ibis-framework==9.2.0
+wasabi==1.1.3
+python-dateutil==2.8.2
+google-generativeai==0.8.3
+google-cloud-aiplatform==1.73.0
+jupyterlab_pygments==0.3.0
+google-cloud-translate==3.17.0
+exceptiongroup==1.2.2
+intel-openmp==2025.0.3
+nvidia-cufft-cu12==11.3.0.4
+timm==1.0.12
+python-slugify==8.0.4
+cryptography==43.0.3
+multipledispatch==1.0.0
+google-crc32c==1.6.0
+rsa==4.9
+cffi==1.17.1
+holidays==0.62
+tinycss2==1.4.0
+google-cloud-iam==2.16.1
+google-cloud-resource-manager==1.13.1
+typeguard==4.4.1
+xlrd==2.0.1
+google==2.0.3
+pandocfilters==1.5.1
+promise==2.3
+progressbar2==4.5.0
+wheel==0.45.1
+google-resumable-media==2.7.2
+einops==0.8.0
+defusedxml==0.7.1
+llvmlite==0.43.0
+attrs==24.2.0
+preshed==3.0.9
+geocoder==1.38.1
+firebase-admin==6.5.0
+ipython==7.34.0
+cvxopt==1.3.2
+greenlet==3.1.1
+confection==0.1.5
+keras==3.5.0
+pandas==2.2.2
+graphviz==0.20.3
+tenacity==9.0.0
+future==1.0.0
+inflect==7.4.0
+langsmith==0.1.147
+babel==2.16.0
+nvidia-cusparse-cu12==12.5.4.2
+importlib_resources==6.4.5
+jiter==0.8.0
+sphinxcontrib-htmlhelp==2.1.0
+moviepy==1.0.3
+typing_extensions==4.12.2
+tcmlib==1.2.0
+snowballstemmer==2.2.0
+scikit-learn==1.5.2
+jsonpatch==1.33
+notebook_shim==0.2.4
+mizani==0.13.0
+simple-parsing==0.1.6
+humanize==4.11.0
+hyperopt==0.2.7
+frozenlist==1.5.0
+uritemplate==4.1.1
+pydata-google-auth==1.9.0
+pyperclip==1.9.0
+lazy_loader==0.4
+bigframes==1.27.0
+numba==0.60.0
+pytensor==2.26.4
+geemap==0.35.1
+polars==1.9.0
+orjson==3.10.12
+fastrlock==0.8.2
+mistune==3.0.2
+sphinxcontrib-applehelp==2.0.0
+mpmath==1.3.0
+mdurl==0.1.2
+async-timeout==4.0.3
+jax==0.4.33
+panel==1.5.4
+patsy==1.0.1
+oauthlib==3.2.2
+librosa==0.10.2.post1
+imutils==0.5.4
+xyzservices==2024.9.0
+Pygments==2.18.0
+sphinxcontrib-jsmath==1.0.1
+pyasn1_modules==0.4.1
+pyproj==3.7.0
+Pyomo==6.8.2
+nvidia-cublas-cu12==12.6.4.1
+numpy==1.26.4
+google-cloud-bigquery-storage==2.27.0
+soxr==0.5.0.post1
+bleach==6.2.0
+sympy==1.13.1
+dask==2024.10.0
+miniKanren==1.0.3
+pathlib==1.0.1
+torch==2.5.1+cu121
+distro==1.9.0
+gym==0.25.2
+lxml==5.3.0
+folium==0.18.0
+altair==4.2.2
+tifffile==2024.9.20
+diffusers==0.31.0
+requests-oauthlib==1.3.1
+google-cloud-language==2.15.1
+ptyprocess==0.7.0
+tensorboard-data-server==0.7.2
+locket==1.0.0
+intel-cmplr-lib-ur==2025.0.3
+lightgbm==4.5.0
+flax==0.8.5
+mdit-py-plugins==0.4.2
+pygame==2.6.1
+pytz==2024.2
+pyparsing==3.2.0
+alabaster==1.0.0
+jupyter_core==5.7.2
+cloudpickle==3.1.0
+logical-unification==0.4.6
+traittypes==0.2.1
+terminado==0.18.1
+beautifulsoup4==4.12.3
+google-cloud-bigquery-connection==1.16.1
+scooby==0.10.0
+google-auth-oauthlib==1.2.1
+protobuf==4.25.5
+astropy==6.1.7
+GDAL==3.6.4
+nbformat==5.10.4
+safetensors==0.4.5
+tzlocal==5.2
+chardet==5.2.0
+psutil==5.9.5
+jsonpointer==3.0.0
+psycopg2==2.9.10
+cachetools==5.5.0
+pyspark==3.5.3
+google-cloud-pubsub==2.27.1
+pillow==11.0.0
+pydantic==2.10.3
+langcodes==3.5.0
+jsonschema-specifications==2024.10.1
+markdown-it-py==3.0.0
+nltk==3.9.1
+nbconvert==7.16.4
+pooch==1.8.2
+huggingface-hub==0.26.3
+tbb==2022.0.0
+ipywidgets==7.7.1
+matplotlib-venn==1.1.1
+rmm-cu12==24.10.0
+sphinxcontrib-serializinghtml==2.0.0
+branca==0.8.0
+gin-config==0.5.0
+bqplot==0.12.43
+opentelemetry-sdk==1.28.2
+community==1.0.0b1
+soundfile==0.12.1
+shap==0.46.0
+joblib==1.4.2
+entrypoints==0.4
+docstring_parser==0.16
+multidict==6.1.0
+grpcio-status==1.62.3
+wcwidth==0.2.13
+geopy==2.4.1
+prettytable==3.12.0
+propcache==0.2.1
+ml-dtypes==0.4.1
+atpublic==4.1.0
+stringzilla==3.11.0
+libclang==18.1.1
+arviz==0.20.0
+requests==2.32.3
+fastprogress==1.0.3
+dlib==19.24.2
+platformdirs==4.3.6
+tabulate==0.9.0
+cufflinks==0.17.3
+spacy-legacy==3.0.12
+grpcio==1.68.1
+cvxpy==1.5.4
+flatbuffers==24.3.25
+pluggy==1.5.0
+regex==2024.9.11
+clarabel==0.9.0
+httplib2==0.22.0
+language_data==1.3.0
+backcall==0.2.0
+nbclient==0.10.1
+ipyleaflet==0.19.2
+PyJWT==2.10.1
+toolz==0.12.1
+opt_einsum==3.4.0
+nvtx==0.2.10
+nvidia-nccl-cu12==2.23.4
+debugpy==1.8.0
+sphinxcontrib-devhelp==2.0.0
+jax-cuda12-pjrt==0.4.33
+missingno==0.5.2
+proglog==0.1.10
+nest-asyncio==1.6.0
+nvidia-cusolver-cu12==11.7.1.2
+gspread-dataframe==3.3.1
+bigquery-magics==0.4.0
+jellyfish==1.1.2
+text-unidecode==1.3
+Deprecated==1.2.15
+srsly==2.4.8
+ipytree==0.2.2
+gcsfs==2024.10.0
+ipyevents==2.0.2
+docker-pycreds==0.4.0
+glob2==0.7
+wordcloud==1.9.4
+traitlets==5.7.1
+nbclassic==1.1.0
+nvidia-cudnn-cu12==9.6.0.74
+easydict==1.13
+httpx==0.28.0
+Jinja2==3.1.4
+argon2-cffi==23.1.0
+linkify-it-py==2.0.3
+optax==0.2.4
+cons==0.4.6
+requests-toolbelt==1.0.0
+editdistance==0.8.1
+jupyter-leaflet==0.19.2
+webcolors==24.11.1
+jax-cuda12-plugin==0.4.33
+albumentations==1.4.20
+PyOpenGL==3.1.7
+tqdm==4.66.6
+googledrivedownloader==0.4
+peft==0.13.2
+absl-py==1.4.0
+eval_type_backport==0.2.0
+opentelemetry-api==1.28.2
+Send2Trash==1.8.3
+gdown==5.2.0
+google-cloud-bigtable==2.27.0
+grpc-google-iam-v1==0.13.1
+rpds-py==0.22.3
+xgboost==2.1.3
+pyviz_comms==3.0.3
+ipykernel==5.5.6
+gym-notices==0.0.8
+opentelemetry-semantic-conventions==0.49b2
+fastcore==1.7.22
+torchvision==0.20.1+cu121
+Sphinx==8.1.3
+ply==3.11
+tensorboard==2.17.1
+namex==0.0.8
+astropy-iers-data==0.2024.12.2.0.35.34
+rpy2==3.4.2
+nvidia-nvjitlink-cu12==12.6.85
+array_record==0.5.1
+PyYAML==6.0.2
+tensorflow==2.17.1
+yellowbrick==1.5
+pylibraft-cu12==24.10.0
+orbax-checkpoint==0.6.4
+Werkzeug==3.1.3
+jupyter-console==6.1.0
+thinc==8.2.5
+etils==1.11.0
+langchain-core==0.3.21
+cmdstanpy==1.2.4
+h5netcdf==1.4.1
+cudf-cu12==24.10.1
+zipp==3.21.0
+PyDrive2==1.21.3
+kiwisolver==1.4.7
+pickleshare==0.7.5
+bokeh==3.6.2
+shellingham==1.5.4
+imageio-ffmpeg==0.5.1
+pycocotools==2.0.8
+sqlglot==25.1.0
+tensorstore==0.1.69
+argon2-cffi-bindings==21.2.0
+sentence-transformers==3.2.1
+docutils==0.21.2
+python-apt==0.0.0
+setuptools==75.1.0
+pip==24.1.2
+requirements-parser==0.9.0
+types-setuptools==75.6.0.20241126
+importlib-metadata==4.6.4
+blinker==1.4
+PyJWT==2.3.0
+PyGObject==3.42.1
+cryptography==3.4.8
+pyparsing==2.4.7
+wadllib==1.3.6
+more-itertools==8.10.0
+zipp==1.0.0
+distro==1.7.0
+six==1.16.0
+python-apt==2.4.0+ubuntu4
+jeepney==0.7.1
+SecretStorage==3.3.1
+oauthlib==3.2.0
+lazr.restfulclient==0.14.4
+httplib2==0.20.2
+launchpadlib==1.10.16
+keyring==23.5.0
+lazr.uri==1.0.6
+dbus-python==1.2.18
+inflect==7.3.1
+wheel==0.43.0
+packaging==24.1
+importlib_metadata==8.0.0
+more-itertools==10.3.0
+platformdirs==4.2.2
+backports.tarfile==1.2.0
+typing_extensions==4.12.2
+jaraco.functools==4.0.1
+jaraco.collections==5.1.0
+tomli==2.0.1
+importlib_resources==6.4.0
+jaraco.text==3.12.1
+jaraco.context==5.3.0
+typeguard==4.3.0
+autocommand==2.2.2
+zipp==3.19.2

wandb/run-20241211_045047-iixgzowh/files/wandb-metadata.json

@@ -0,0 +1,38 @@
+{
+  "os": "Linux-6.1.85+-x86_64-with-glibc2.35",
+  "python": "CPython 3.10.12",
+  "startedAt": "2024-12-11T04:50:47.418923Z",
+  "program": "m2-congretimbau-focal_loss-sempartido.ipynb",
+  "email": "adrianobf@gmail.com",
+  "root": "/content",
+  "host": "fd55a770be24",
+  "username": "root",
+  "executable": "/usr/bin/python3",
+  "colab": "https://colab.research.google.com/notebook#fileId=1a_b6x6zKkekdeqrCzP83ovWk7MhdV3DO",
+  "cpu_count": 6,
+  "cpu_count_logical": 12,
+  "gpu": "NVIDIA A100-SXM4-40GB",
+  "gpu_count": 1,
+  "disk": {
+    "/": {
+      "total": "120942624768",
+      "used": "41967308800"
+    }
+  },
+  "memory": {
+    "total": "89632796672"
+  },
+  "cpu": {
+    "count": 6,
+    "countLogical": 12
+  },
+  "gpu_nvidia": [
+    {
+      "name": "NVIDIA A100-SXM4-40GB",
+      "memoryTotal": "42949672960",
+      "cudaCores": 6912,
+      "architecture": "Ampere"
+    }
+  ],
+  "cudaVersion": "12.2"
+}

wandb/run-20241211_045047-iixgzowh/files/wandb-summary.json

@@ -0,0 +1 @@
+{"train/learning_rate":8.23529411764706e-06,"train_samples_per_second":68.228,"_step":28,"train/loss":0.0596,"eval/accuracy":0.7891156462585034,"train/grad_norm":3.049489736557007,"eval/f1":0.7272727272727273,"eval/loss":0.18769244849681854,"eval/steps_per_second":3.366,"train_loss":0.19622788826624551,"train/epoch":6,"train_steps_per_second":2.134,"_runtime":299.898605572,"eval/precision":0.712819947043248,"train_runtime":295.2158,"eval/recall":0.7563795853269537,"eval/samples_per_second":98.949,"total_flos":2.68854917606352e+15,"train/global_step":210,"eval/runtime":1.4856,"_wandb":{"runtime":303},"_timestamp":1.7338929473636777e+09}

wandb/run-20241211_045047-iixgzowh/logs/debug-core.log

@@ -0,0 +1,9 @@
+{"time":"2024-12-11T04:50:47.169454897Z","level":"INFO","msg":"started logging, with flags","port-filename":"/tmp/tmpesc6uqba/port-8104.txt","pid":8104,"debug":false,"disable-analytics":false}
+{"time":"2024-12-11T04:50:47.169488816Z","level":"INFO","msg":"FeatureState","shutdownOnParentExitEnabled":false}
+{"time":"2024-12-11T04:50:47.174185219Z","level":"INFO","msg":"Will exit if parent process dies.","ppid":8104}
+{"time":"2024-12-11T04:50:47.174179307Z","level":"INFO","msg":"server is running","addr":{"IP":"127.0.0.1","Port":46865,"Zone":""}}
+{"time":"2024-12-11T04:50:47.35848897Z","level":"INFO","msg":"connection: ManageConnectionData: new connection created","id":"127.0.0.1:37854"}
+{"time":"2024-12-11T04:50:47.420017098Z","level":"INFO","msg":"handleInformInit: received","streamId":"iixgzowh","id":"127.0.0.1:37854"}
+{"time":"2024-12-11T04:50:47.522713383Z","level":"INFO","msg":"handleInformInit: stream started","streamId":"iixgzowh","id":"127.0.0.1:37854"}
+{"time":"2024-12-11T04:55:51.925715482Z","level":"INFO","msg":"handleInformFinish: finish message received","streamId":"iixgzowh","id":"127.0.0.1:37854"}
+{"time":"2024-12-11T04:55:51.925914139Z","level":"INFO","msg":"handleInformFinish: stream closed","streamId":"iixgzowh","id":"127.0.0.1:37854"}

wandb/run-20241211_045047-iixgzowh/logs/debug-internal.log

@@ -0,0 +1,43 @@
+{"time":"2024-12-11T04:50:47.420166727Z","level":"INFO","msg":"using version","core version":"0.19.0"}
+{"time":"2024-12-11T04:50:47.420188806Z","level":"INFO","msg":"created symlink","path":"/content/wandb/run-20241211_045047-iixgzowh/logs/debug-core.log"}
+{"time":"2024-12-11T04:50:47.522675109Z","level":"INFO","msg":"created new stream","id":"iixgzowh"}
+{"time":"2024-12-11T04:50:47.522707089Z","level":"INFO","msg":"stream: started","id":"iixgzowh"}
+{"time":"2024-12-11T04:50:47.522760019Z","level":"INFO","msg":"handler: started","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:50:47.522741946Z","level":"INFO","msg":"writer: Do: started","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:50:47.522818391Z","level":"INFO","msg":"sender: started","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:50:48.347627641Z","level":"INFO","msg":"Starting system monitor"}
+{"time":"2024-12-11T04:50:48.997536401Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:50:48.997570241Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:50:48.997576117Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:50:48.997579979Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:50:48.997583404Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:50:48.997586701Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:50:49.577041341Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:50:49.618452446Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:45.869880542Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:45.874900215Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:47.366091729Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:47.370222766Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:47.370839646Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:47.376849547Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:47.451397371Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:47.456005601Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:47.4588096Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:47.464120605Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:50.562786625Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:50.603587514Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:50.603613208Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:50.603618039Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:50.60362293Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:50.603633564Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:50.603637242Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-11T04:55:50.603640545Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-11T04:55:50.603661142Z","level":"INFO","msg":"Stopping system monitor"}
+{"time":"2024-12-11T04:55:50.604205943Z","level":"INFO","msg":"Stopped system monitor"}
+{"time":"2024-12-11T04:55:50.862348476Z","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
+{"time":"2024-12-11T04:55:50.91175051Z","level":"INFO","msg":"handler: operation stats","stats":{}}
+{"time":"2024-12-11T04:55:51.925784605Z","level":"INFO","msg":"stream: closing","id":"iixgzowh"}
+{"time":"2024-12-11T04:55:51.925811603Z","level":"INFO","msg":"handler: closed","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:55:51.92582357Z","level":"INFO","msg":"writer: Close: closed","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:55:51.925832625Z","level":"INFO","msg":"sender: closed","stream_id":"iixgzowh"}
+{"time":"2024-12-11T04:55:51.925904519Z","level":"INFO","msg":"stream: closed","id":"iixgzowh"}

wandb/run-20241211_045047-iixgzowh/logs/debug.log

@@ -0,0 +1,76 @@
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_setup.py:_flush():68] Current SDK version is 0.19.0
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_setup.py:_flush():68] Configure stats pid to 8104
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_setup.py:_flush():68] Loading settings from /content/wandb/settings
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_setup.py:_flush():68] Loading settings from environment variables
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_init.py:_log_setup():528] Logging user logs to /content/wandb/run-20241211_045047-iixgzowh/logs/debug.log
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_init.py:_log_setup():529] Logging internal logs to /content/wandb/run-20241211_045047-iixgzowh/logs/debug-internal.log
+2024-12-11 04:50:47,415 INFO    MainThread:8104 [wandb_init.py:_jupyter_setup():474] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x79e4275fb3d0>
+2024-12-11 04:50:47,416 INFO    MainThread:8104 [wandb_init.py:init():639] calling init triggers
+2024-12-11 04:50:47,416 INFO    MainThread:8104 [wandb_init.py:init():645] wandb.init called with sweep_config: {}
+config: {}
+2024-12-11 04:50:47,416 INFO    MainThread:8104 [wandb_init.py:init():688] starting backend
+2024-12-11 04:50:47,416 INFO    MainThread:8104 [wandb_init.py:init():692] sending inform_init request
+2024-12-11 04:50:47,418 INFO    MainThread:8104 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2024-12-11 04:50:47,418 INFO    MainThread:8104 [wandb_init.py:init():705] backend started and connected
+2024-12-11 04:50:47,425 INFO    MainThread:8104 [wandb_run.py:_label_probe_notebook():1327] probe notebook
+2024-12-11 04:50:48,259 INFO    MainThread:8104 [wandb_init.py:init():798] updated telemetry
+2024-12-11 04:50:48,259 INFO    MainThread:8104 [wandb_init.py:init():830] communicating run to backend with 90.0 second timeout
+2024-12-11 04:50:48,341 INFO    MainThread:8104 [wandb_init.py:init():882] starting run threads in backend
+2024-12-11 04:50:48,957 INFO    MainThread:8104 [wandb_run.py:_console_start():2443] atexit reg
+2024-12-11 04:50:48,957 INFO    MainThread:8104 [wandb_run.py:_redirect():2293] redirect: wrap_raw
+2024-12-11 04:50:48,957 INFO    MainThread:8104 [wandb_run.py:_redirect():2358] Wrapping output streams.
+2024-12-11 04:50:48,958 INFO    MainThread:8104 [wandb_run.py:_redirect():2383] Redirects installed.
+2024-12-11 04:50:48,959 INFO    MainThread:8104 [wandb_init.py:init():925] run started, returning control to user process
+2024-12-11 04:50:48,963 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:50:48,963 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:50:48,968 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:50:48,968 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:50:48,968 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:50:48,976 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:50:48,978 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:50:48,978 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:50:48,984 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:50:49,576 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:50:49,576 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:50:49,581 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:50:49,974 INFO    MainThread:8104 [wandb_run.py:_config_callback():1375] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['BertForMaskedLM'], 'finetuning_task': None, 'id2label': {0: '0', 1: '1'}, 'label2id': {'0': 0, '1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'belisards/congretimbau', '_attn_implementation_autoset': True, 'transformers_version': '4.47.0', 'directionality': 'bidi', 'model_type': 'bert', 'output_past': True, 'pooler_fc_size': 768, 'pooler_num_attention_heads': 12, 'pooler_num_fc_layers': 3, 'pooler_size_per_head': 128, 'pooler_type': 'first_token_transform', 'vocab_size': 29794, 'hidden_size': 1024, 'num_hidden_layers': 24, 'num_attention_heads': 16, 'hidden_act': 'gelu', 'intermediate_size': 4096, 'hidden_dropout_prob': 0.05, 'attention_probs_dropout_prob': 0.05, 'max_position_embeddings': 512, 'type_vocab_size': 2, 'initializer_range': 0.02, 'layer_norm_eps': 1e-12, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '.', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 32, 'per_device_eval_batch_size': 32, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 1e-05, 'weight_decay': 0.02, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 18, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 120, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Dec11_04-50-48_fd55a770be24', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 204, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 5151, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 102, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': 'm2-congretimbau_tunado', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'f1', 'greater_is_better': True, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False}
+2024-12-11 04:50:49,978 INFO    MainThread:8104 [wandb_config.py:__setitem__():154] config set model/num_parameters = 334398466 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x79e3ac5f6380>>
+2024-12-11 04:50:49,978 INFO    MainThread:8104 [wandb_run.py:_config_callback():1375] config_cb model/num_parameters 334398466 None
+2024-12-11 04:55:45,869 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:45,869 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:45,874 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:47,365 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:47,365 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:47,370 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:47,370 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:47,370 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:47,376 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:47,450 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:47,451 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:47,455 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:47,458 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:47,458 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:47,463 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:50,562 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:50,562 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:50,569 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:50,571 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:50,571 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:50,576 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:50,589 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:50,589 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:50,594 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:50,594 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:50,594 INFO    MainThread:8104 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-11 04:55:50,598 INFO    MainThread:8104 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-11 04:55:50,599 INFO    MainThread:8104 [wandb_run.py:_finish():2169] finishing run adrianobf/AzMina-M2/iixgzowh
+2024-12-11 04:55:50,599 INFO    MainThread:8104 [jupyter.py:save_history():459] not saving jupyter history
+2024-12-11 04:55:50,600 INFO    MainThread:8104 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-11 04:55:50,600 INFO    MainThread:8104 [wandb_init.py:_jupyter_teardown():456] cleaning up jupyter logic
+2024-12-11 04:55:50,600 INFO    MainThread:8104 [wandb_run.py:_atexit_cleanup():2408] got exitcode: 0
+2024-12-11 04:55:50,600 INFO    MainThread:8104 [wandb_run.py:_restore():2390] restore
+2024-12-11 04:55:50,600 INFO    MainThread:8104 [wandb_run.py:_restore():2396] restore done
+2024-12-11 04:55:51,914 INFO    MainThread:8104 [wandb_run.py:_footer_history_summary_info():3951] rendering history
+2024-12-11 04:55:51,915 INFO    MainThread:8104 [wandb_run.py:_footer_history_summary_info():3983] rendering summary
+2024-12-11 04:55:51,922 INFO    MainThread:8104 [wandb_run.py:_footer_sync_info():3912] logging synced files