corneille97
/

llama-2-7b-4bits-turbo

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Llama2 quantized 4bit model with bitsandbytes.

Downloads last month: 7

Safetensors

Model size

3.6B params

Tensor type

F32

·

FP16

·

U8

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for corneille97/llama-2-7b-4bits-turbo

Quantizations

1 model