Add README
Browse files
README.md
CHANGED
|
@@ -15,7 +15,9 @@ This model was finetuned and converted to GGUF format using [Unsloth](https://gi
|
|
| 15 |
- For multimodal models: **llama-mtmd-cli** **-m** model_name.gguf **--mmproj** mmproj_file.gguf
|
| 16 |
|
| 17 |
## Available Model files:
|
| 18 |
-
- `Qwen2.5-VL-7B-Instruct.
|
|
|
|
|
|
|
| 19 |
- `Qwen2.5-VL-7B-Instruct.BF16-mmproj.gguf`
|
| 20 |
|
| 21 |
## ⚠️ Ollama Note for Vision Models
|
|
|
|
| 15 |
- For multimodal models: **llama-mtmd-cli** **-m** model_name.gguf **--mmproj** mmproj_file.gguf
|
| 16 |
|
| 17 |
## Available Model files:
|
| 18 |
+
- `Qwen2.5-VL-7B-Instruct.Q5_K_M.gguf`
|
| 19 |
+
- `Qwen2.5-VL-7B-Instruct.Q8_0.gguf`
|
| 20 |
+
- `Qwen2.5-VL-7B-Instruct.Q4_K_M.gguf`
|
| 21 |
- `Qwen2.5-VL-7B-Instruct.BF16-mmproj.gguf`
|
| 22 |
|
| 23 |
## ⚠️ Ollama Note for Vision Models
|