rafaeloc15/mistral-small-v5

README.md

@@ -20,7 +20,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the generator dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0370
+- Loss: 0.0424
 
 ## Model description
 
@@ -52,8 +52,8 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 0.0516        | 1.0   | 268  | 0.0495          |
-| 0.0393        | 2.0   | 536  | 0.0370          |
+| 0.0614        | 1.0   | 464  | 0.0561          |
+| 0.0464        | 2.0   | 928  | 0.0424          |
 
 
 ### Framework versions

adapter_config.json

@@ -6,6 +6,7 @@
   "fan_in_fan_out": false,
   "inference_mode": true,
   "init_lora_weights": true,
+  "layer_replication": null,
   "layers_pattern": null,
   "layers_to_transform": null,
   "loftq_config": {},

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d6c0cde07c559318e0dc4af4c3a278cc3547384e114ac2aa9aa78216f957ed1d
+oid sha256:d4d0e0dedc4c7916dad7e5c95d4f77a8593d7765902fc2cff0c4b8cae24366fb
 size 109069176

runs/Apr12_15-13-53_e6c5c418f5fd/events.out.tfevents.1712935104.e6c5c418f5fd.162.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:98cc06420640832490b123ce6e1dbbece5661dfff0cb99ad568b1a9d005f352a
+size 5061

runs/Apr12_15-37-39_e6c5c418f5fd/events.out.tfevents.1712936376.e6c5c418f5fd.162.5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d56e090edf12e65ec580f72097e019014d43123d6acaae43187a2d722d27cc55
+size 25321

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:56b2d091aa5702b516be959e5dd70db67e57a0104418c5551125ccf39e7f7272
+oid sha256:8f830bdfd4b7fde5b8e907c86943d9c700ebbc3e58ddad3a0d333f9667dabcc6
 size 4920