Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
yinfupai
/
Baichuan-13B-Chat-GPTQ
like
1
Text Generation
Transformers
PyTorch
Chinese
baichuan
custom_code
text-generation-inference
Inference Endpoints
4-bit precision
gptq
License:
mit
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
请问这是4bit的量化么？
#1
by
pbjacob
- opened
Sep 1, 2023
Discussion
pbjacob
Sep 1, 2023
看模型文件大小为7G多。
可以做一个8bit量化的GPTQ模型么？谢谢！
另：
测试了一下，确实不错，反应快，输出内容符合预期。再次感谢。
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
