Edit model card

Model Details

This is 01-ai/Yi-6B quantized and serialized with bitsandbytes in 4-bit.

Details here:

Yi: Fine-tune and Run One the Best Bilingual LLMs on Your Computer

Downloads last month
14
Safetensors
Model size
3.38B params
Tensor type
F32
·
FP16
·
U8
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including kaitchup/Yi-6B-bnb-4bit