Vui Seng Chua
commited on
Commit
•
73d74ae
1
Parent(s):
43a66d3
Revise README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,7 @@
|
|
1 |
## OpenVINO Weight-Quantized LLMs
|
2 |
|
3 |
This repo contains binary of weight quantized by [OpenVINO](https://github.com/openvinotoolkit/openvino_notebooks/blob/main/notebooks/254-llm-chatbot/254-llm-chatbot.ipynb).
|
|
|
4 |
| LLM | ratio | group_size |
|
5 |
|----------------- |------- |------------ |
|
6 |
| llama-2-chat-7b | 0.8 | 128 |
|
|
|
1 |
## OpenVINO Weight-Quantized LLMs
|
2 |
|
3 |
This repo contains binary of weight quantized by [OpenVINO](https://github.com/openvinotoolkit/openvino_notebooks/blob/main/notebooks/254-llm-chatbot/254-llm-chatbot.ipynb).
|
4 |
+
|
5 |
| LLM | ratio | group_size |
|
6 |
|----------------- |------- |------------ |
|
7 |
| llama-2-chat-7b | 0.8 | 128 |
|