File size: 1,138 Bytes
6b09722 cda5b59 6b09722 9ff533b 6b09722 2f35dd3 46b4663 440c9ff 57d4d68 46b4663 7cc634b 9afddca 7cc634b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 |
---
tags:
- experimental
- testing
- gguf
- roleplay
- multimodal
- vision
- llava
---
# #Roleplay #Multimodal #Vision
**These are quants for an experimental model.**
quantization_options = [
"Q4_K_M", "Q4_K_S", "IQ4_XS",
"Q5_K_M", "Q5_K_S",
"Q6_K", "Q8_0"
]
Original model weights and information: <br> https://huggingface.co/Nitral-AI/Eris_PrimeV4.69-Vision-32k-7B
MMPROJ: <br> [./mmproj/mmproj-model-f16.gguf](./mmproj/mmproj-model-f16.gguf)
# Vision/multimodal capabilities:
If you want to use vision functionality:
* You must use the latest version of [KoboldCpp](https://github.com/LostRuins/koboldcpp).
To use the multimodal capabilities of this model and use **vision** you need to load the specified **mmproj** file, this can be found inside this model repo.
* You can load the **mmproj** by using the corresponding section in the interface:
|