rafaeloc15/mistral-small-v5

README.md

@@ -20,7 +20,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the generator dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0424
+- Loss: 0.0433
 
 ## Model description
 
@@ -52,8 +52,8 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 0.0614        | 1.0   | 464  | 0.0561          |
-| 0.0464        | 2.0   | 928  | 0.0424          |
+| 0.0618        | 1.0   | 401  | 0.0579          |
+| 0.0471        | 2.0   | 802  | 0.0433          |
 
 
 ### Framework versions

adapter_config.json

@@ -6,6 +6,7 @@
   "fan_in_fan_out": false,
   "inference_mode": true,
   "init_lora_weights": true,
+  "layer_replication": null,
   "layers_pattern": null,
   "layers_to_transform": null,
   "loftq_config": {},

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d4d0e0dedc4c7916dad7e5c95d4f77a8593d7765902fc2cff0c4b8cae24366fb
+oid sha256:7a8d440b290a6a7163205813497d5cf349c36710ffb0eb1ff86df6dd8b239003
 size 109069176

runs/Apr15_11-56-17_a3c9d11ff418/events.out.tfevents.1713182276.a3c9d11ff418.668.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7f40b3b610ff777ccc49351d340267d2ae1f10cf86c7597379b0f5d695527021
+size 10034

runs/Apr15_11-56-17_a3c9d11ff418/events.out.tfevents.1713182422.a3c9d11ff418.668.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:abef5c83d593056e100e2e09a47a49870d856acff4dc2b4e0f35cd77273fb212
+size 22789

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8f830bdfd4b7fde5b8e907c86943d9c700ebbc3e58ddad3a0d333f9667dabcc6
+oid sha256:1a4a5e19f0f2e97a5899521a1e3351525fa6d1bd06675ca697824cbdf5b0eedf
 size 4920