LoneStriker
/

Yi-34B-Spicyboros-3.1-2-LoRA

Text Generation

generated_from_trainer

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

LoneStriker commited on Nov 18, 2023

Commit

bd1a130

•

1 Parent(s): d604504

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
 [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
-# Fine-tune of Y-34B with Spicyboros-3.1
 Three epochs of fine tuning with @jondurbin's SpicyBoros-3.1 dataset.  4.65bpw should fit on a single 3090/4090, 5.0bpw, 6.0bpw, and 8.0bpw will require more than one GPU 24 GB VRAM GPU.
 **Please note:** you may have to turn down repetition penalty to 1.0. The model seems to get into "thesaurus" mode sometimes without this change.

 [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
+# Fine-tune of Yi-34B with Spicyboros-3.1
 Three epochs of fine tuning with @jondurbin's SpicyBoros-3.1 dataset.  4.65bpw should fit on a single 3090/4090, 5.0bpw, 6.0bpw, and 8.0bpw will require more than one GPU 24 GB VRAM GPU.
 **Please note:** you may have to turn down repetition penalty to 1.0. The model seems to get into "thesaurus" mode sometimes without this change.