IntellectusAI commited on
Commit
ebd4d71
1 Parent(s): b0c852a

End of training

Browse files
README.md CHANGED
@@ -14,6 +14,8 @@ model-index:
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
  should probably proofread and complete it, then remove this comment. -->
16
 
 
 
17
  # zephyr_beta
18
 
19
  This model is a fine-tuned version of [TheBloke/zephyr-7B-alpha-GPTQ](https://huggingface.co/TheBloke/zephyr-7B-alpha-GPTQ) on the None dataset.
@@ -41,7 +43,7 @@ The following hyperparameters were used during training:
41
  - seed: 42
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: cosine
44
- - training_steps: 250
45
  - mixed_precision_training: Native AMP
46
 
47
  ### Training results
@@ -50,8 +52,8 @@ The following hyperparameters were used during training:
50
 
51
  ### Framework versions
52
 
53
- - PEFT 0.11.1
54
- - Transformers 4.40.2
55
- - Pytorch 2.2.0
56
  - Datasets 2.19.1
57
  - Tokenizers 0.19.1
 
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
  should probably proofread and complete it, then remove this comment. -->
16
 
17
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/praxisbusiness/huggingface/runs/v89nj10m)
18
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/praxisbusiness/huggingface/runs/v89nj10m)
19
  # zephyr_beta
20
 
21
  This model is a fine-tuned version of [TheBloke/zephyr-7B-alpha-GPTQ](https://huggingface.co/TheBloke/zephyr-7B-alpha-GPTQ) on the None dataset.
 
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: cosine
46
+ - training_steps: 200
47
  - mixed_precision_training: Native AMP
48
 
49
  ### Training results
 
52
 
53
  ### Framework versions
54
 
55
+ - PEFT 0.11.2.dev0
56
+ - Transformers 4.42.0.dev0
57
+ - Pytorch 2.3.0+cu121
58
  - Datasets 2.19.1
59
  - Tokenizers 0.19.1
runs/May28_11-21-19_e6addf98c5a3/events.out.tfevents.1716895393.e6addf98c5a3.572.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f0a3a2785d4eafe6b83f2b572c7a0cd4e68674e8baf3fbef851194578e1134b5
3
- size 6364
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d9d56f097005ec123ac3806a9abb0994b8921411879115bf8da46f0f66b1f59
3
+ size 6718