Hugging Face's logo

TheBloke
/
Vicuna-7B-v1-3-SuperHOT-8K-fp16

Text Generation
Transformers
PyTorch
llama
custom_code
text-generation-inference
Model card Files Community
TheBloke commited on
Commit
62442cf
•
1 Parent(s): 07ea928

Fix model description

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -19,7 +19,7 @@ license: other
19
 
20
  # LmSys' Vicuna 7B v1.3 fp16
21
 
22
- These files are GPTQ 4bit model files for [LmSys' Vicuna 7B v1.3](https://huggingface.co/lmsys/vicuna-7b-v1.3) merged with [Kaio Ken's SuperHOT 8K](https://huggingface.co/kaiokendev/superhot-7b-8k-no-rlhf-test).
23
 
24
  [Kaio Ken's SuperHOT 7b LoRA](https://huggingface.co/kaiokendev/superhot-7b-8k-no-rlhf-test) is merged on to the base model, and then 8K context can be achieved during inference by using `trust_remote_code=True`.
25
 
 
19
 
20
  # LmSys' Vicuna 7B v1.3 fp16
21
 
22
+ These are fp16 pytorch format model files for [LmSys' Vicuna 7B v1.3](https://huggingface.co/lmsys/vicuna-7b-v1.3) merged with [Kaio Ken's SuperHOT 8K](https://huggingface.co/kaiokendev/superhot-7b-8k-no-rlhf-test).
23
 
24
  [Kaio Ken's SuperHOT 7b LoRA](https://huggingface.co/kaiokendev/superhot-7b-8k-no-rlhf-test) is merged on to the base model, and then 8K context can be achieved during inference by using `trust_remote_code=True`.
25