Update README.md
Browse files
README.md
CHANGED
@@ -1,15 +1,15 @@
|
|
1 |
---
|
2 |
{}
|
3 |
---
|
4 |
-
# GGUF quants for [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) using [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
5 |
|
6 |
-
**Terms of Use**:
|
7 |
|
8 |
<picture>
|
9 |
<img alt="cthulhu" src="https://aeiljuispo.cloudimg.io/v7/https://cdn-uploads.huggingface.co/production/uploads/60dcb384e9b23a7d7dd67923/mytCV6MDmIwdhDKsf14Qy.png?w=400&h=400&f=face">
|
10 |
</picture>
|
11 |
|
12 |
-
##
|
13 |
|
14 |
* `q2_k`: Uses Q4_K for the attention.vw and feed_forward.w2 tensors, Q2_K for the other tensors.
|
15 |
* `q3_k_s`: Uses Q3_K for all tensors
|
|
|
1 |
---
|
2 |
{}
|
3 |
---
|
4 |
+
# GGUF quants for [**mistralai/Mistral-7B-v0.1**](https://huggingface.co/mistralai/Mistral-7B-v0.1) using [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
5 |
|
6 |
+
**Terms of Use**: Please check the [**original model**](https://huggingface.co/mistralai/Mistral-7B-v0.1)
|
7 |
|
8 |
<picture>
|
9 |
<img alt="cthulhu" src="https://aeiljuispo.cloudimg.io/v7/https://cdn-uploads.huggingface.co/production/uploads/60dcb384e9b23a7d7dd67923/mytCV6MDmIwdhDKsf14Qy.png?w=400&h=400&f=face">
|
10 |
</picture>
|
11 |
|
12 |
+
## Quants
|
13 |
|
14 |
* `q2_k`: Uses Q4_K for the attention.vw and feed_forward.w2 tensors, Q2_K for the other tensors.
|
15 |
* `q3_k_s`: Uses Q3_K for all tensors
|