saksornr
/

SeaLLM-7B-v2.5-4bit

Text Generation

transformers accelerate bitsandbytes

text-generation-inference

4-bit precision

Model card Files Files and versions Community

saksornr commited on Apr 27

Commit

f1f8168

•

1 Parent(s): 4119e0e

Update README.md

Files changed (1) hide show

README.md +1 -3

README.md CHANGED Viewed

@@ -17,6 +17,4 @@ base_model: SeaLLMs/SeaLLM-7B-v2.5
 - **License:** apache-2.0
 - **Finetuned from model :** SeaLLMs/SeaLLM-7B-v2.5
-This gemma model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
-[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)

 - **License:** apache-2.0
 - **Finetuned from model :** SeaLLMs/SeaLLM-7B-v2.5
+Pre-quantized for faster loading. (~17 GB to 5 GB)