KasaiDanto commited on
Commit
441e333
·
verified ·
1 Parent(s): 50845d7

End of training

Browse files
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.8731
20
 
21
  ## Model description
22
 
@@ -49,8 +49,8 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:------:|:----:|:---------------:|
52
- | 2.0283 | 0.9999 | 3912 | 1.9877 |
53
- | 1.8342 | 1.9999 | 7824 | 1.8731 |
54
 
55
 
56
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.8753
20
 
21
  ## Model description
22
 
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:------:|:----:|:---------------:|
52
+ | 2.0282 | 0.9999 | 3912 | 1.9913 |
53
+ | 1.8359 | 1.9999 | 7824 | 1.8753 |
54
 
55
 
56
  ### Framework versions
adapter_config.json CHANGED
@@ -23,13 +23,13 @@
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
26
- "o_proj",
27
- "gate_proj",
28
- "v_proj",
29
  "q_proj",
30
- "up_proj",
31
  "k_proj",
32
- "down_proj"
 
 
 
 
33
  ],
34
  "task_type": "CAUSAL_LM",
35
  "use_dora": false,
 
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
 
 
 
26
  "q_proj",
 
27
  "k_proj",
28
+ "v_proj",
29
+ "down_proj",
30
+ "up_proj",
31
+ "o_proj",
32
+ "gate_proj"
33
  ],
34
  "task_type": "CAUSAL_LM",
35
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2865cbe6c61197fb3216c4f09b3a30e02100a3abc1dfc0e75081e74056590000
3
  size 41581360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8da6f3dbe733ac47c06fba7bda016d5e584db81408cf04b053b5744923fd057
3
  size 41581360
runs/Dec17_09-36-49_d3fe6e2dc7c3/events.out.tfevents.1734428210.d3fe6e2dc7c3.24.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9aa40959aed067dc1aa2f0f7d08b684256ce9c29b3f8ca8e2efdff5717c4d360
3
+ size 9734
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b9187f89902527abfcfd7b5e59ab9ba41ccddb2bfe9eea937531bf5080eada94
3
  size 5240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d611d6b33680a34110ae1dab24d1a2f0c00ad68343156f4d624282967675b6c
3
  size 5240