Update README.md
Browse files
README.md
CHANGED
|
@@ -37,6 +37,8 @@ Q_8_0 which is very good; need a reasonable size of RAM otherwise you might expe
|
|
| 37 |
|
| 38 |
f16 is similar to the original hf model; opt this one or hf also fine; make sure you have a good machine
|
| 39 |
|
|
|
|
|
|
|
| 40 |
### how to run it
|
| 41 |
|
| 42 |
use any connector for interacting with gguf; i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
|
|
|
|
| 37 |
|
| 38 |
f16 is similar to the original hf model; opt this one or hf also fine; make sure you have a good machine
|
| 39 |
|
| 40 |
+
* the latest update includes Q_4_0, Q_4_1 (belongs to Q4 family) and Q_5_0, Q_5_1 (belongs to Q5 family)
|
| 41 |
+
|
| 42 |
### how to run it
|
| 43 |
|
| 44 |
use any connector for interacting with gguf; i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
|