tmpupload
/

superhot-30b-8k-no-rlhf-test-GPTQ

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

tmpupload commited on Jun 27, 2023

Commit

1eb3954

•

1 Parent(s): ee215b8

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,7 +3,7 @@ license: other
 ---
 # superhot-30b-8k-4bit--1g-safetensors
-**Note: Maximum sequence length (max_seq_len) and compression factor (compress_pos_emb) need to be set to 8192 and 4.**
 Merged base LLaMA and LoRA with this:
 https://github.com/tloen/alpaca-lora

 ---
 # superhot-30b-8k-4bit--1g-safetensors
+**Note: Maximum sequence length (max_seq_len) and compression factor (compress_pos_emb) need to be set to 8192 (or lower) and 4.**
 Merged base LLaMA and LoRA with this:
 https://github.com/tloen/alpaca-lora