End of training

README.md

@@ -0,0 +1,59 @@
+---
+license: apache-2.0
+base_model: distilroberta-base
+tags:
+- generated_from_trainer
+model-index:
+- name: rubik_roberta
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# rubik_roberta
+
+This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.0512
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 3
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss |
+|:-------------:|:-----:|:-----:|:---------------:|
+| 0.1666        | 1.0   | 3334  | 0.1127          |
+| 0.0928        | 2.0   | 6668  | 0.0649          |
+| 0.0707        | 3.0   | 10002 | 0.0509          |
+
+
+### Framework versions
+
+- Transformers 4.36.2
+- Pytorch 2.3.0.dev20240108
+- Datasets 2.16.1
+- Tokenizers 0.15.0

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f356e2095a5f37396e2b8e48f0bb2e7c965ae286b21c3bcbdf8991de6b2d1f52
+oid sha256:b93e208bcd0a8c4eb15a323a04a612f5f4252703bc08b7d6629b477f65913ae3
 size 328693404

runs/Jan20_20-17-45_MacBook-Pro-de-Maxence.local/events.out.tfevents.1705778268.MacBook-Pro-de-Maxence.local.36048.2

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5762fd2b2653b834f14c155563ad55728777a18f4b4a831b3bb79d04ece18da6
-size 6674
+oid sha256:80d3727c5c94931508c979073ec06f9d05fbf25c35e7cf0b92801b4ee9535a39
+size 8669

runs/Jan20_20-17-45_MacBook-Pro-de-Maxence.local/events.out.tfevents.1705785200.MacBook-Pro-de-Maxence.local.36048.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e491b5e06699a8c7e4a8aaf9280428b45c4f7f1c2c3600234af5aded10178b68
+size 359