Anthonyg5005
commited on
Commit
•
8afc4e0
1
Parent(s):
1bbbf96
Update README.md
Browse files
README.md
CHANGED
@@ -39,6 +39,7 @@ Feel free to send in PRs or use this code however you'd like.\
|
|
39 |
|
40 |
- Auto EXL2 HF upload
|
41 |
- This script is designed to automate the process of quantizing models to EXL2 and uploading them to the HF Hub as seperate branches. This is both available to run on Windows and Linux. You will be required to be logged in to HF Hub. If you are not logged in, you will need a WRITE token.
|
|
|
42 |
|
43 |
- EXL2 Local Quants
|
44 |
- Easily creates environment to quantize models to exl2 to your local machine. Supports both Windows and Linux.
|
|
|
39 |
|
40 |
- Auto EXL2 HF upload
|
41 |
- This script is designed to automate the process of quantizing models to EXL2 and uploading them to the HF Hub as seperate branches. This is both available to run on Windows and Linux. You will be required to be logged in to HF Hub. If you are not logged in, you will need a WRITE token.
|
42 |
+
- [Example repo](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2)
|
43 |
|
44 |
- EXL2 Local Quants
|
45 |
- Easily creates environment to quantize models to exl2 to your local machine. Supports both Windows and Linux.
|