End of training

README.md

@@ -1,6 +1,4 @@
 ---
-license: mit
-base_model: LIAMF-USP/roberta-large-finetuned-race
 tags:
 - generated_from_trainer
 metrics:
@@ -18,11 +16,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 # roberta-mqa-rat
 
-This model is a fine-tuned version of [LIAMF-USP/roberta-large-finetuned-race](https://huggingface.co/LIAMF-USP/roberta-large-finetuned-race) on an unknown dataset.
+This model was trained from scratch on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.6094
 - Accuracy: 0.2144
 - F1: 0.1861
+- Loss: 1.6094
 - Precision: 0.2104
 - Recall: 0.2059
 
@@ -54,11 +52,11 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step  | Validation Loss | Accuracy | F1     | Precision | Recall |
-|:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:---------:|:------:|
-| 1.6189        | 1.0   | 3712  | 1.6094          | 0.2097   | 0.0731 | 0.0854    | 0.1997 |
-| 1.6176        | 2.0   | 7424  | 1.6094          | 0.2084   | 0.0971 | 0.1999    | 0.1982 |
-| 1.6154        | 3.0   | 11136 | 1.6094          | 0.2144   | 0.1861 | 0.2104    | 0.2059 |
+| Training Loss | Epoch | Step  | Accuracy | F1     | Validation Loss | Precision | Recall |
+|:-------------:|:-----:|:-----:|:--------:|:------:|:---------------:|:---------:|:------:|
+| 1.6189        | 1.0   | 3712  | 0.2097   | 0.0731 | 1.6094          | 0.0854    | 0.1997 |
+| 1.6176        | 2.0   | 7424  | 0.2084   | 0.0971 | 1.6094          | 0.1999    | 0.1982 |
+| 1.6154        | 3.0   | 11136 | 0.2144   | 0.1861 | 1.6094          | 0.2104    | 0.2059 |
 
 
 ### Framework versions

tokenizer.json

@@ -2,13 +2,13 @@
   "version": "1.0",
   "truncation": {
     "direction": "Right",
-    "max_length": 256,
+    "max_length": 320,
     "strategy": "LongestFirst",
     "stride": 0
   },
   "padding": {
     "strategy": {
-      "Fixed": 256
+      "Fixed": 320
     },
     "direction": "Right",
     "pad_to_multiple_of": null,

tokenizer_config.json

@@ -48,10 +48,17 @@
   "eos_token": "</s>",
   "errors": "replace",
   "mask_token": "<mask>",
+  "max_length": 128,
   "model_max_length": 512,
+  "pad_to_multiple_of": null,
   "pad_token": "<pad>",
+  "pad_token_type_id": 0,
+  "padding_side": "right",
   "sep_token": "</s>",
+  "stride": 0,
   "tokenizer_class": "RobertaTokenizer",
   "trim_offsets": true,
+  "truncation_side": "right",
+  "truncation_strategy": "longest_first",
   "unk_token": "<unk>"
 }

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:44f821910103f34f39e67b6d3374a73688d8e48bbecffae46dfa5c6a155737ad
+oid sha256:76ee26ff7d8fb303073b380f7923ffecc736bbf9d6868b0d62a174456dfa2145
 size 4920