GreenBitAI
/

Llama-3-70B-instruct-layer-mix-bpw-4.0

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Edit model card

GreenBit LLMs

This is GreenBitAI's pretrained low-bit LLMs with extreme compression yet still strong performance.

Please refer to our Github page for the code to run the model and more information.

Downloads last month: 7

Safetensors

Model size

11.7B params

Tensor type

FP16

·

I32

·

I16

·

Collection including GreenBitAI/Llama-3-70B-instruct-layer-mix-bpw-4.0

GreenBitAI Llama-3

GreenBitAI's Llama 3 family in low-bit format • 20 items • Updated 28 days ago • 1