nakodanei commited on
Commit
01b4fc3
1 Parent(s): 6aa9294

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -1,3 +1,9 @@
1
  ---
2
  license: llama2
3
  ---
 
 
 
 
 
 
 
1
  ---
2
  license: llama2
3
  ---
4
+ GGUF quantisation of https://huggingface.co/Lin-Chen/ShareGPT4V-7B
5
+
6
+ You can run the model with llama.cpp server, then visit the server webpage to upload an image. Example:
7
+ ```
8
+ .\server.exe -m ".\models\ShareGPT4V-7B_Q5_K_M.gguf" -t 6 -c 4096 -ngl 26 --mmproj ".\models\mmproj-model-f16.gguf"
9
+ ```