---
library_name: transformers
tags: []
---

# BrokenSoul/GPT2-GPTQ-4bit

<!-- Provide a quick summary of what the model is/does. -->
This is a GPT2 Quantized model following this tutorial: [4-bit LLM Quantization with GPTQ](https://mlabonne.github.io/blog/posts/4_bit_Quantization_with_GPTQ.html).