Update README.md
Browse files
README.md
CHANGED
|
@@ -11,4 +11,6 @@ Original model: [Poro-34B-chat](https://huggingface.co/LumiOpen/Poro-34B-chat)
|
|
| 11 |
|
| 12 |
GGUF-format model files quantized using [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
| 13 |
|
| 14 |
-
We have Q4_K_M and Q5_K_M quantized models available.
|
|
|
|
|
|
|
|
|
| 11 |
|
| 12 |
GGUF-format model files quantized using [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
| 13 |
|
| 14 |
+
We have Q4_K_M and Q5_K_M quantized models available.
|
| 15 |
+
|
| 16 |
+
Chat with the quantized models on this [colab notebook](https://colab.research.google.com/drive/1l_tpldjvbHSZskFCtjLT-NQTaDalPnTk?usp=sharing).
|