feelconstantfear
/

gemma-2-2b-it-abliterated-GPTQ-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

feelconstantfear/gemma-2-2b-it-abliterated-GPTQ-4bit

Model: gemma-2-2b-it-abliterated
Made by: IlyaGusev

Quantization notes

Made with GPTQ with the c4 dataset.

Downloads last month: 6

Safetensors

Model size

861M params

Tensor type

I32

·

FP16

·

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for feelconstantfear/gemma-2-2b-it-abliterated-GPTQ-4bit

Base model

IlyaGusev/gemma-2-2b-it-abliterated

Quantized

(14)

this model