hongyin
/

chat-llama2-70b-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

hongyin commited on Nov 17, 2023

Commit

1e85ed6

•

1 Parent(s): 86fd3aa

Update README.txt

Files changed (1) hide show

README.txt +2 -2

README.txt CHANGED Viewed

@@ -4,9 +4,9 @@ language:
 - zh
 pipeline_tag: text-generation
 ---
-## hongyin/chat-informer-70b-80k
-I am pleased to introduce an English-Chinese conversation assistant designed to reduce the cost of inference. It is trained based on the Llama2-chat-70B, with a unique vocabulary and 70 billion parameters.
 Losing fat is the only way to solve all problems.

 - zh
 pipeline_tag: text-generation
 ---
+## hongyin/chat-llama2-70b-4bit
+I am pleased to introduce a 4-bit quantized version of the Llama2-chat-70B based model, dedicated to reducing the cost of training and inference.
 Losing fat is the only way to solve all problems.