leafspark commited on
Commit
215480b
1 Parent(s): e362e9c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -2
README.md CHANGED
@@ -20,5 +20,10 @@ Using llama.cpp fork: [https://github.com/fairydreaming/llama.cpp/tree/deepseek-
20
  - Merged GGUF should appear
21
 
22
  # Quants:
23
- - bf16
24
- - q8_0
 
 
 
 
 
 
20
  - Merged GGUF should appear
21
 
22
  # Quants:
23
+ - bf16 (generating, 85% complete)
24
+ - f16 (after q4_k_m, but just use bf16)
25
+ - f32 (may require some time to upload, after q8_0)
26
+ - q8_0 (after bf16)
27
+ - q4_k_m (after q8_0)
28
+
29
+ If quantize.exe supports it I will make RTN quants.