Lewdiculous commited on
Commit
58bcc76
1 Parent(s): b31244a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md CHANGED
@@ -15,5 +15,47 @@ tags:
15
 
16
  Original model weights: <br> https://huggingface.co/Nitral-AI/Eris_PrimeV4-Vision-7B
17
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
 
19
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/5_Pr7t9cD4MBZRkJ4hwpF.png)
 
15
 
16
  Original model weights: <br> https://huggingface.co/Nitral-AI/Eris_PrimeV4-Vision-7B
17
 
18
+ # Vision/multimodal capabilities:
19
+
20
+ <details><summary>
21
+ Click here to see how this would work in practice in a roleplay chat.
22
+ </summary>
23
+
24
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/qGO0nIfZVcyuio5J07sU-.jpeg)
25
+
26
+ </details><br>
27
+
28
+ <details><summary>
29
+ Click here to see what your SillyTavern Image Captions extension settings should look like.
30
+ </summary>
31
+
32
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/UpXOnVrzvsMRYeqMaSOaa.jpeg)
33
+
34
+ </details><br>
35
+
36
+ **If you want to use vision functionality:**
37
+
38
+ * Make sure you are using the latest version of [KoboldCpp](https://github.com/LostRuins/koboldcpp).
39
+
40
+ To use the multimodal capabilities of this model, such as **vision**, you also need to load the specified **mmproj** file, you can get it [here](https://huggingface.co/cjpais/llava-1.6-mistral-7b-gguf/blob/main/mmproj-model-f16.gguf), it's also hosted in this repository inside the **mmproj** folder.
41
+
42
+ * You can load the **mmproj** by using the corresponding section in the interface:
43
+
44
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/UX6Ubss2EPNAT3SKGMLe0.png)
45
+
46
+ * For CLI users, you can load the **mmproj file** by adding the respective flag to your usual command:
47
+
48
+ ```
49
+ --mmproj your-mmproj-file.gguf
50
+ ```
51
+
52
+ # Quantization information:
53
+
54
+ **Steps performed:**
55
+
56
+ ```
57
+ Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)
58
+ ```
59
+ *Using the latest llama.cpp at the time.*
60
 
61
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/5_Pr7t9cD4MBZRkJ4hwpF.png)