Gemma-2-2B
Collection
36 items
•
Updated
This model is a fine-tuned version of google/gemma-2-2b-it on the GaetanMichelet/chat-60_ft_task-2 and the GaetanMichelet/chat-120_ft_task-2 datasets. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
Training Loss | Epoch | Step | Validation Loss |
---|---|---|---|
1.356 | 0.9091 | 5 | 1.3237 |
1.3153 | 2.0 | 11 | 1.2306 |
1.1344 | 2.9091 | 16 | 1.1313 |
1.0582 | 4.0 | 22 | 1.0518 |
0.9757 | 4.9091 | 27 | 0.9752 |
0.8903 | 6.0 | 33 | 0.9265 |
0.8676 | 6.9091 | 38 | 0.9079 |
0.8368 | 8.0 | 44 | 0.8935 |
0.8107 | 8.9091 | 49 | 0.8845 |
0.8061 | 10.0 | 55 | 0.8781 |
0.7712 | 10.9091 | 60 | 0.8747 |
0.747 | 12.0 | 66 | 0.8742 |
0.7182 | 12.9091 | 71 | 0.8779 |
0.7025 | 14.0 | 77 | 0.8851 |
0.626 | 14.9091 | 82 | 0.8947 |
0.633 | 16.0 | 88 | 0.9076 |
0.583 | 16.9091 | 93 | 0.9299 |
0.5357 | 18.0 | 99 | 0.9467 |
0.5232 | 18.9091 | 104 | 0.9674 |