Hugging Face's logo

bala3040
/
balagpt-ft2

PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
bala3040 commited on
Commit
e86579e
•
1 Parent(s): d4b6418

bala3040/finally_done2

Browse files
Files changed (4) hide show
  1. README.md +7 -8
  2. adapter_model.safetensors +1 -1
  3. runs/Aug10_16-21-13_0d8ded2d4a53/events.out.tfevents.1723306880.0d8ded2d4a53.649.0 +3 -0
  4. training_args.bin +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [TheBloke/Mistral-7B-Instruct-v0.2-GPTQ](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GPTQ) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.8438
20
 
21
  ## Model description
22
 
@@ -44,22 +44,21 @@ The following hyperparameters were used during training:
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
  - lr_scheduler_warmup_steps: 2
47
- - num_epochs: 3
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
- | 2.1065 | 0.9231 | 9 | 1.4824 |
55
- | 1.1553 | 1.9487 | 19 | 0.9793 |
56
- | 0.7704 | 2.7692 | 27 | 0.8438 |
57
 
58
 
59
  ### Framework versions
60
 
61
- - PEFT 0.11.1
62
- - Transformers 4.41.2
63
- - Pytorch 2.1.0+cu121
64
  - Datasets 2.20.0
65
  - Tokenizers 0.19.1
 
16
 
17
  This model is a fine-tuned version of [TheBloke/Mistral-7B-Instruct-v0.2-GPTQ](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GPTQ) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.2277
20
 
21
  ## Model description
22
 
 
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
  - lr_scheduler_warmup_steps: 2
47
+ - num_epochs: 2
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
+ | 2.1183 | 0.9231 | 9 | 1.5159 |
55
+ | 1.2188 | 1.8462 | 18 | 1.2277 |
 
56
 
57
 
58
  ### Framework versions
59
 
60
+ - PEFT 0.12.0
61
+ - Transformers 4.42.4
62
+ - Pytorch 2.3.1+cu121
63
  - Datasets 2.20.0
64
  - Tokenizers 0.19.1
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8f21bfdf96de82956129050d87fc5b7f6e8852f47eab987307fba0efb9a44295
3
  size 8397056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26768d8163fc09085344ab791feef7392f4a8a083746280ddeb78c2d04b6a7e0
3
  size 8397056
runs/Aug10_16-21-13_0d8ded2d4a53/events.out.tfevents.1723306880.0d8ded2d4a53.649.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e668ac7e78d98eb93827638b9825fdbbc7ab9ebb6c293cc1583a839cbe284ce
3
+ size 6776
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b7c5ddd89521a4abe1dbfc0eab0fce560afe5656bc5823edcef32529e5547385
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1fb82942e2e8dd7d07d936c16166a78d5008617d29c6006237588a9cfc896e39
3
  size 5112