vuiseng9
/

ov-weight-quantized-llms

Model card Files Files and versions Community

Vui Seng Chua commited on Mar 21

Commit

73d74ae

•

1 Parent(s): 43a66d3

Revise README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -1,6 +1,7 @@
 ## OpenVINO Weight-Quantized LLMs
 This repo contains binary of weight quantized by [OpenVINO](https://github.com/openvinotoolkit/openvino_notebooks/blob/main/notebooks/254-llm-chatbot/254-llm-chatbot.ipynb).
 | LLM             	| ratio 	| group_size 	|
 |-----------------	|-------	|------------	|
 | llama-2-chat-7b 	| 0.8   	| 128        	|

 ## OpenVINO Weight-Quantized LLMs
 This repo contains binary of weight quantized by [OpenVINO](https://github.com/openvinotoolkit/openvino_notebooks/blob/main/notebooks/254-llm-chatbot/254-llm-chatbot.ipynb).
 | LLM             	| ratio 	| group_size 	|
 |-----------------	|-------	|------------	|
 | llama-2-chat-7b 	| 0.8   	| 128        	|