TheBloke
/

Vicuna-13B-1-3-SuperHOT-8K-fp16

Text Generation

text-generation-inference

Model card Files Files and versions Community

TheBloke commited on Jul 2, 2023

Commit

4ab48fc

•

1 Parent(s): 7fc49a5

Fix model description

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ license: other
 # LmSys' Vicuna 13B 1.3.0 merged with Kaio Ken's SuperHOT 8K fp16
-These files are GPTQ 4bit model files for [LmSys' Vicuna 13B 1.3.0 merged with Kaio Ken's SuperHOT 8K](https://huggingface.co/lmsys/vicuna-13b-v1.3) merged with [Kaio Ken's SuperHOT 8K](https://huggingface.co/kaiokendev/superhot-13b-8k-no-rlhf-test).
 [Kaio Ken's SuperHOT 30B LoRA](https://huggingface.co/kaiokendev/superhot-30b-8k-no-rlhf-test) is merged on to the base model, and then 8K context can be achieved during inference by using `trust_remote_code=True`.

 # LmSys' Vicuna 13B 1.3.0 merged with Kaio Ken's SuperHOT 8K fp16
+This is fp16 pytorch format model files for [LmSys' Vicuna 13B 1.3.0 merged with Kaio Ken's SuperHOT 8K](https://huggingface.co/lmsys/vicuna-13b-v1.3) merged with [Kaio Ken's SuperHOT 8K](https://huggingface.co/kaiokendev/superhot-13b-8k-no-rlhf-test).
 [Kaio Ken's SuperHOT 30B LoRA](https://huggingface.co/kaiokendev/superhot-30b-8k-no-rlhf-test) is merged on to the base model, and then 8K context can be achieved during inference by using `trust_remote_code=True`.