mradermacher
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -46,7 +46,7 @@ And they are generally (but not always) generated in the order above, for which
|
|
46 |
|
47 |
For models less than 11B size, I experimentally generate f16 versions at the moment (in the static repository).
|
48 |
|
49 |
-
For models less than 15B in size, the "arm only" Q4_0_4_4/Q4_0_4_8/Q4_0_8_8 quants will be generated
|
50 |
|
51 |
Older models that pre-date introduction of new quant types generally will have them retrofitted, hopefully
|
52 |
this year. At least when multiple quant types are missing, as it is hard to justify a big mdoel download
|
|
|
46 |
|
47 |
For models less than 11B size, I experimentally generate f16 versions at the moment (in the static repository).
|
48 |
|
49 |
+
For models less than 15B in size, the "arm only" Q4_0_4_4 static and Q4_0_4_4/Q4_0_4_8/Q4_0_8_8 imatrix quants will be generated.
|
50 |
|
51 |
Older models that pre-date introduction of new quant types generally will have them retrofitted, hopefully
|
52 |
this year. At least when multiple quant types are missing, as it is hard to justify a big mdoel download
|