Ashley37sky commited on
Commit
a3b86c9
1 Parent(s): c4356fa

Model save

Browse files
Files changed (2) hide show
  1. README.md +67 -0
  2. adapter_model.safetensors +1 -1
README.md ADDED
@@ -0,0 +1,67 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: peft
3
+ license: apache-2.0
4
+ base_model: Qwen/Qwen2.5-1.5B-Instruct
5
+ tags:
6
+ - generated_from_trainer
7
+ model-index:
8
+ - name: qwen_checkpoints
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # qwen_checkpoints
16
+
17
+ This model is a fine-tuned version of [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) on an unknown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 0.0716
20
+ - Mse: 0.0716
21
+ - Mae: 0.2183
22
+ - R Squared: 0.2014
23
+
24
+ ## Model description
25
+
26
+ More information needed
27
+
28
+ ## Intended uses & limitations
29
+
30
+ More information needed
31
+
32
+ ## Training and evaluation data
33
+
34
+ More information needed
35
+
36
+ ## Training procedure
37
+
38
+ ### Training hyperparameters
39
+
40
+ The following hyperparameters were used during training:
41
+ - learning_rate: 0.0001
42
+ - train_batch_size: 64
43
+ - eval_batch_size: 64
44
+ - seed: 42
45
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
+ - lr_scheduler_type: cosine
47
+ - lr_scheduler_warmup_ratio: 0.01
48
+ - num_epochs: 2
49
+ - mixed_precision_training: Native AMP
50
+
51
+ ### Training results
52
+
53
+ | Training Loss | Epoch | Step | Validation Loss | Mse | Mae | R Squared |
54
+ |:-------------:|:------:|:----:|:---------------:|:------:|:------:|:---------:|
55
+ | 0.0856 | 0.1558 | 100 | 0.0878 | 0.0878 | 0.2351 | 0.0207 |
56
+ | 0.0843 | 0.3115 | 200 | 0.0803 | 0.0803 | 0.2314 | 0.1045 |
57
+ | 0.0851 | 0.4673 | 300 | 0.0882 | 0.0882 | 0.2278 | 0.0168 |
58
+ | 0.0676 | 0.6231 | 400 | 0.0716 | 0.0716 | 0.2183 | 0.2014 |
59
+
60
+
61
+ ### Framework versions
62
+
63
+ - PEFT 0.13.2
64
+ - Transformers 4.45.2
65
+ - Pytorch 2.5.1+cu121
66
+ - Datasets 3.1.0
67
+ - Tokenizers 0.20.3
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1ab76746e973d36d23025d83a27a81588550bccc3822f322c75a75868e8e7dd8
3
  size 34886416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1aafa5482ec5b2cd865da8892f7b9b92c04d27c161cc80b1468e86bea0f5b32b
3
  size 34886416