End of training

README.md

@@ -103,7 +103,7 @@ xformers_attention: null
 
 This model is a fine-tuned version of [unsloth/Llama-3.2-1B](https://huggingface.co/unsloth/Llama-3.2-1B) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.9005
+- Loss: 1.9065
 
 ## Model description
 
@@ -139,9 +139,9 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 1.5917        | 0.0001 | 1    | 1.9595          |
-| 1.0265        | 0.0002 | 3    | 1.9565          |
-| 1.2777        | 0.0005 | 6    | 1.9385          |
-| 1.4144        | 0.0007 | 9    | 1.9005          |
+| 1.0263        | 0.0002 | 3    | 1.9572          |
+| 1.2796        | 0.0005 | 6    | 1.9417          |
+| 1.4155        | 0.0007 | 9    | 1.9065          |
 
 
 ### Framework versions

adapter_config.json

@@ -20,13 +20,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "up_proj",
-    "q_proj",
+    "gate_proj",
     "o_proj",
+    "up_proj",
     "v_proj",
-    "down_proj",
     "k_proj",
-    "gate_proj"
+    "q_proj",
+    "down_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9306abb79bfdf74156f08a8d428293cfb376bfc4bab0853a8ba1216cdd0d9524
+oid sha256:82e1c5e1d51956371875ff43601cde8dc568626151dc74e3774d23ca2ab3cc1e
 size 22624970

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7df5ced5b60e62c81f9e4fb78a9d5e1379c6bdd142e626a309607d5a68cc3843
+oid sha256:e771b270da7293af440a639bb209ca6898df7fae0d30097d348edd3e55716225
 size 22573704

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:478a261d562ef7004d0f64e3e27b2ba59d503990d5008804b57fbc37d15611f7
+oid sha256:923ce18a73524fc48b19c36dee905217bafd6d65025d46d8a80d999e0fe09dba
 size 6776