GreenBitAI
/

01-Yi-34B-layer-mix-bpw-2.5

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Edit model card

GreenBit LLMs

This is GreenBitAI's pretrained low-bit LLMs with extreme compression yet still strong performance.

Please refer to our Github page for the code to run the model and more information.

Downloads last month: 0

Safetensors

Model size

4.41B params

Tensor type

I32

·

FP16

·

I16

·

Collection including GreenBitAI/01-Yi-34B-layer-mix-bpw-2.5

GreenBitAI 01-Yi

GreenBitAI's 01-Yi family in low-bit format • 18 items • Updated 22 days ago