Update README.md
Browse files
README.md
CHANGED
@@ -11,8 +11,8 @@ It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com
|
|
11 |
|
12 |
## Other repositories available
|
13 |
|
14 |
-
* [
|
15 |
-
* [
|
16 |
* [Original unquantised fp16 model in HF format](https://huggingface.co/project-baize/baize-v2-13b)
|
17 |
|
18 |
## How to easily download and use this model in text-generation-webui
|
|
|
11 |
|
12 |
## Other repositories available
|
13 |
|
14 |
+
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/Project-Baize-v2-13B-GPTQ)
|
15 |
+
* [4-bit, 5-bit and 8-bit GGML models for CPU(+GPU) inference](https://huggingface.co/TheBloke/Project-Baize-v2-13B-GGML)
|
16 |
* [Original unquantised fp16 model in HF format](https://huggingface.co/project-baize/baize-v2-13b)
|
17 |
|
18 |
## How to easily download and use this model in text-generation-webui
|