Hugging Face's logo

Rahul0098
/
model

PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
Rahul0098 commited on
Commit
e5081a3
•
1 Parent(s): 0171b87

Model save

Browse files
Files changed (6) hide show
  1. README.md +14 -14
  2. adapter_config.json +3 -3
  3. adapter_model.safetensors +1 -1
  4. runs/Apr01_08-24-56_fdc5e912607d/events.out.tfevents.1711959896.fdc5e912607d.2505.0 +2 -2
  5. tokenizer.json +1 -1
  6. training_args.bin +1 -1
README.md CHANGED
@@ -3,9 +3,9 @@ license: apache-2.0
3
  library_name: peft
4
  tags:
5
  - generated_from_trainer
6
- base_model: Falconsai/text_summarization
7
  metrics:
8
  - rouge
 
9
  model-index:
10
  - name: model
11
  results: []
@@ -18,12 +18,12 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [Falconsai/text_summarization](https://huggingface.co/Falconsai/text_summarization) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 3.5828
22
- - Rouge1: 0.066
23
- - Rouge2: 0.0111
24
- - Rougel: 0.0546
25
- - Rougelsum: 0.0546
26
- - Gen Len: 20.0
27
 
28
  ## Model description
29
 
@@ -55,16 +55,16 @@ The following hyperparameters were used during training:
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
58
- | 4.3163 | 1.0 | 600 | 3.6773 | 0.0623 | 0.0095 | 0.0514 | 0.0513 | 20.0 |
59
- | 4.0156 | 2.0 | 1200 | 3.6124 | 0.0646 | 0.0105 | 0.0534 | 0.0533 | 20.0 |
60
- | 3.9641 | 3.0 | 1800 | 3.5887 | 0.0659 | 0.0111 | 0.0546 | 0.0545 | 20.0 |
61
- | 3.931 | 4.0 | 2400 | 3.5828 | 0.066 | 0.0111 | 0.0546 | 0.0546 | 20.0 |
62
 
63
 
64
  ### Framework versions
65
 
66
- - PEFT 0.10.1.dev0
67
- - Transformers 4.39.1
68
- - Pytorch 2.2.1
69
  - Datasets 2.18.0
70
  - Tokenizers 0.15.2
 
3
  library_name: peft
4
  tags:
5
  - generated_from_trainer
 
6
  metrics:
7
  - rouge
8
+ base_model: Falconsai/text_summarization
9
  model-index:
10
  - name: model
11
  results: []
 
18
 
19
  This model is a fine-tuned version of [Falconsai/text_summarization](https://huggingface.co/Falconsai/text_summarization) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 3.2990
22
+ - Rouge1: 0.1186
23
+ - Rouge2: 0.0198
24
+ - Rougel: 0.094
25
+ - Rougelsum: 0.094
26
+ - Gen Len: 19.9958
27
 
28
  ## Model description
29
 
 
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
58
+ | 3.896 | 1.0 | 600 | 3.3871 | 0.1105 | 0.0171 | 0.0874 | 0.0874 | 20.0 |
59
+ | 3.6922 | 2.0 | 1200 | 3.3257 | 0.116 | 0.0196 | 0.0921 | 0.0921 | 20.0 |
60
+ | 3.6451 | 3.0 | 1800 | 3.3037 | 0.1189 | 0.0203 | 0.0947 | 0.0947 | 19.9972 |
61
+ | 3.6179 | 4.0 | 2400 | 3.2990 | 0.1186 | 0.0198 | 0.094 | 0.094 | 19.9958 |
62
 
63
 
64
  ### Framework versions
65
 
66
+ - PEFT 0.10.0
67
+ - Transformers 4.39.2
68
+ - Pytorch 2.2.1+cu121
69
  - Datasets 2.18.0
70
  - Tokenizers 0.15.2
adapter_config.json CHANGED
@@ -20,10 +20,10 @@
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
23
- "k",
24
- "q",
25
  "v",
26
- "o"
 
 
27
  ],
28
  "task_type": "CAUSAL_LM",
29
  "use_dora": false,
 
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
 
 
23
  "v",
24
+ "o",
25
+ "q",
26
+ "k"
27
  ],
28
  "task_type": "CAUSAL_LM",
29
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:814e787ab3afbf14f475e652e06419d5f097585d552aee220f7240caad1f2dac
3
  size 9457304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6288ab31dfd20e19a2fcae257436dcb1e20d546fc04dfd2c2c685c8a1bbb7ff1
3
  size 9457304
runs/Apr01_08-24-56_fdc5e912607d/events.out.tfevents.1711959896.fdc5e912607d.2505.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:828376f7b1073e8ccd5ccdb28fb181a26a5e2caee646e4c8a37a9207ddd8de9e
3
- size 8496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4f4685a54edfc014989319610d28315e2fe64338428ab648fcf85ebed70b9d9
3
+ size 9375
tokenizer.json CHANGED
@@ -2,7 +2,7 @@
2
  "version": "1.0",
3
  "truncation": {
4
  "direction": "Right",
5
- "max_length": 512,
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
 
2
  "version": "1.0",
3
  "truncation": {
4
  "direction": "Right",
5
+ "max_length": 128,
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:23190c98d14958fd7d0c9050bad987a8aa8792dd8af315f2c1fabea65798727d
3
  size 5048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:440635b622791efa901046be5414e9b48fe8cd34e36bc9b30471cf76dedf8a21
3
  size 5048