hierholzer
commited on
Commit
•
d4b665d
1
Parent(s):
4316109
Update README.md
Browse files
README.md
CHANGED
@@ -47,19 +47,26 @@ Models initially developed in frameworks like PyTorch can be converted to GGUF f
|
|
47 |
|
48 |
## ☑️Uploaded Quantization Types
|
49 |
|
50 |
-
Here are the quantized versions available:
|
51 |
-
|
52 |
-
- [
|
53 |
-
- [x]
|
54 |
-
- [x]
|
55 |
-
- [x]
|
56 |
-
- [
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
57 |
|
58 |
Feel Free to reach out to me if you need a specific Quantization Type that I do not currently offer.
|
59 |
|
60 |
|
61 |
### 📈All Quantization Types Possible
|
62 |
-
Below is a table of all the Quantication Types that are possible.
|
63 |
|
64 |
| **#** | **or** | **Q#** | **:** | _Description Of Quantization Types_ |
|
65 |
|-------|:------:|:------:|:-----:|----------------------------------------------------------------|
|
|
|
47 |
|
48 |
## ☑️Uploaded Quantization Types
|
49 |
|
50 |
+
Here are the quantized versions that I have available:
|
51 |
+
|
52 |
+
- [ ] Q2_K
|
53 |
+
- [x] Q3_K_S
|
54 |
+
- [x] Q3_K_M
|
55 |
+
- [x] Q3_K_L
|
56 |
+
- [x] Q4_K_S
|
57 |
+
- [x] Q4_K_M ~ *Recommended*
|
58 |
+
- [x] Q5_K_S ~ *Recommended*
|
59 |
+
- [x] Q5_K_M ~ *Recommended*
|
60 |
+
- [ ] Q6_K
|
61 |
+
- [ ] Q8_0 ~ *NOT Recommended*
|
62 |
+
- [ ] F16 ~ *NOT Recommended*
|
63 |
+
- [ ] F32 ~ *NOT Recommended*
|
64 |
|
65 |
Feel Free to reach out to me if you need a specific Quantization Type that I do not currently offer.
|
66 |
|
67 |
|
68 |
### 📈All Quantization Types Possible
|
69 |
+
Below is a table of all the Quantication Types that are possible as well as short descriptions.
|
70 |
|
71 |
| **#** | **or** | **Q#** | **:** | _Description Of Quantization Types_ |
|
72 |
|-------|:------:|:------:|:-----:|----------------------------------------------------------------|
|