TigerResearch
/

tigerbot-13b-chat-v4-4bit-exl2

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

vivicai commited on Dec 5, 2023

Commit

d2ee089

•

1 Parent(s): 360eb08

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -13,7 +13,7 @@ license: apache-2.0
-This is a 4-bit EXL2 version of the [Tigerbot 13b chat](https://huggingface.co/TigerResearch/tigerbot-13b-chat).
 It was quantized to 4bit using: https://github.com/turboderp/exllamav2
@@ -41,5 +41,5 @@ cd exllamav2
 pip install -r requirements.txt
 # infer command
-CUDA_VISIBLE_DEVICES=0 python other_infer/exllamav2_hf_infer.py --model_path TigerResearch/tigerbot-13b-chat-4bit-exl2
 ```

+This is a 4-bit EXL2 version of the [Tigerbot 13b chat_v4](https://huggingface.co/TigerResearch/tigerbot-13b-chat-v4).
 It was quantized to 4bit using: https://github.com/turboderp/exllamav2
 pip install -r requirements.txt
 # infer command
+CUDA_VISIBLE_DEVICES=0 python other_infer/exllamav2_hf_infer.py --model_path TigerResearch/tigerbot-13b-chat-v4-4bit-exl2
 ```