Update README.md
Browse files
README.md
CHANGED
|
@@ -20,6 +20,10 @@ inference: false
|
|
| 20 |
|
| 21 |
# long-t5-tglobal-xl-16384-book-summary: the 8-bit quantized version
|
| 22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
This is an 8-bit quantized version of the `pszemraj/long-t5-tglobal-xl-16384-book-summary` model, The model has been compressed using `bitsandbytes` and can be loaded with low memory usage.
|
| 24 |
|
| 25 |
Refer to the [original model](https://huggingface.co/pszemraj/long-t5-tglobal-xl-16384-book-summary) for all details about the model architecture and training process. For more information on loading 8-bit models, refer to the `4.28.0` [release information](https://github.com/huggingface/transformers/releases/tag/v4.28.0) and the [example repository](https://huggingface.co/ybelkada/bloom-1b7-8bit).
|
|
|
|
| 20 |
|
| 21 |
# long-t5-tglobal-xl-16384-book-summary: the 8-bit quantized version
|
| 22 |
|
| 23 |
+
<a href="https://colab.research.google.com/gist/pszemraj/c19e32baf876deb866c31cd46c86e893/long-t5-xl-accelerate-test.ipynb">
|
| 24 |
+
<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
|
| 25 |
+
</a>
|
| 26 |
+
|
| 27 |
This is an 8-bit quantized version of the `pszemraj/long-t5-tglobal-xl-16384-book-summary` model, The model has been compressed using `bitsandbytes` and can be loaded with low memory usage.
|
| 28 |
|
| 29 |
Refer to the [original model](https://huggingface.co/pszemraj/long-t5-tglobal-xl-16384-book-summary) for all details about the model architecture and training process. For more information on loading 8-bit models, refer to the `4.28.0` [release information](https://github.com/huggingface/transformers/releases/tag/v4.28.0) and the [example repository](https://huggingface.co/ybelkada/bloom-1b7-8bit).
|