Commit
•
8057e61
1
Parent(s):
ca2c162
Update README.md
Browse files
README.md
CHANGED
|
@@ -86,7 +86,7 @@ ollama run octopus-planning-Q4_K_M "<|user|>Find my presentation for tomorrow's
|
|
| 86 |
# Quantized GGUF Models Benchmark
|
| 87 |
|
| 88 |
| Name | Quant method | Bits | Size | Use Cases |
|
| 89 |
-
|
|
| 90 |
| octopus-planning-Q2_K.gguf | Q2_K | 2 | 1.42 GB | fast but high loss, not recommended |
|
| 91 |
| octopus-planning-Q3_K.gguf | Q3_K | 3 | 1.96 GB | extremely not recommended |
|
| 92 |
| octopus-planning-Q3_K_S.gguf | Q3_K_S | 3 | 1.68 GB | extremely not recommended |
|
|
|
|
| 86 |
# Quantized GGUF Models Benchmark
|
| 87 |
|
| 88 |
| Name | Quant method | Bits | Size | Use Cases |
|
| 89 |
+
| ---------------------------- | ------------ | ---- | -------- | ----------------------------------- |
|
| 90 |
| octopus-planning-Q2_K.gguf | Q2_K | 2 | 1.42 GB | fast but high loss, not recommended |
|
| 91 |
| octopus-planning-Q3_K.gguf | Q3_K | 3 | 1.96 GB | extremely not recommended |
|
| 92 |
| octopus-planning-Q3_K_S.gguf | Q3_K_S | 3 | 1.68 GB | extremely not recommended |
|