tmpupload
/

superhot-13b-16k-no-rlhf-test-GPTQ

Text Generation

Inference Endpoints

Model card Files Files and versions Community

tmpupload commited on Jun 27, 2023

Commit

70440c7

•

1 Parent(s): 6749fdb

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,7 +3,7 @@ license: other
 ---
 # superhot-13b-16k-4bit--1g-safetensors
-**Note: Maximum sequence length (max_seq_len) and compression factor (compress_pos_emb) need to be set to 16384 and 8.**
 Merged base LLaMA and LoRA with this:
 https://github.com/tloen/alpaca-lora

 ---
 # superhot-13b-16k-4bit--1g-safetensors
+**Note: Maximum sequence length (max_seq_len) and compression factor (compress_pos_emb) need to be set to 16384 (or lower) and 8.**
 Merged base LLaMA and LoRA with this:
 https://github.com/tloen/alpaca-lora