End of training

README.md

@@ -102,7 +102,7 @@ xformers_attention: true
 
 This model is a fine-tuned version of [unsloth/Llama-3.2-1B](https://huggingface.co/unsloth/Llama-3.2-1B) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.4894
+- Loss: 0.4895
 
 ## Model description
 
@@ -140,8 +140,8 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 5.3734        | 0.0229 | 1    | 5.7448          |
-| 0.4691        | 0.5731 | 25   | 0.5327          |
-| 0.379         | 1.1461 | 50   | 0.4894          |
+| 0.4731        | 0.5731 | 25   | 0.5357          |
+| 0.3817        | 1.1461 | 50   | 0.4895          |
 
 
 ### Framework versions

adapter_config.json

@@ -20,13 +20,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "down_proj",
     "up_proj",
-    "v_proj",
-    "o_proj",
     "q_proj",
+    "o_proj",
     "k_proj",
-    "gate_proj"
+    "v_proj",
+    "gate_proj",
+    "down_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:56a6409f7fb1c702ecff5b35d24e282f0142d173a4018d3b853e8ee53ef05adf
+oid sha256:6950bd54face645cafead78d4484b20406beb54b9655867fe698c487dc20db05
 size 90258378

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:934c417838770417091496d57694c16214b63ebf07326638c467b9ddd2104c94
+oid sha256:98272708b6bbcbd3897853bb6762aa8f8e39c8e5beb8ad70dd3a41f8cd0fa629
 size 90207248

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:595f13f9b541b1821e9d98d762bfaf4708c03c003f626eee9ea3aebae6357ba6
+oid sha256:1d76f26d77bea81bf37439ed33d8fcf7a5fb5304d81c23c42d88d1d67e1cebef
 size 6776