BrokenSoul
/

GPT2-GPTQ-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

GPT2-GPTQ-4bit / README.md

BrokenSoul's picture

Update README.md

578137d verified 3 months ago

|

history blame contribute delete

No virus

298 Bytes

metadata

library_name: transformers
tags: []

BrokenSoul/GPT2-GPTQ-4bit

This is a GPT2 Quantized model following this tutorial: 4-bit LLM Quantization with GPTQ.