BoyaWu10 commited on
Commit
4031a42
1 Parent(s): 943ee34

update prompt

Browse files
Files changed (1) hide show
  1. README.md +10 -4
README.md CHANGED
@@ -28,10 +28,14 @@ We provide Bunny-Llama-3-8B-V, which is built upon [SigLIP](https://huggingface.
28
  # sample images can be found in images folder
29
 
30
  # fp16
31
- ./llava-cli -m ggml-model-f16.gguf --mmproj mmproj-model-f16.gguf --image example_2.png -c 4096 -p "Why is the image funny?" --temp 0.0
 
 
32
 
33
  # int4
34
- ./llava-cli -m ggml-model-Q4_K_M.gguf --mmproj mmproj-model-f16.gguf --image example_2.png -c 4096 -p "Why is the image funny?" --temp 0.0
 
 
35
  ```
36
 
37
  ## Chat by [ollama](https://ollama.com/)
@@ -41,10 +45,12 @@ We provide Bunny-Llama-3-8B-V, which is built upon [SigLIP](https://huggingface.
41
 
42
  # fp16
43
  ollama create Bunny-Llama-3-8B-V-fp16 -f ./ollama-f16
44
- ollama run Bunny-Llama-3-8B-V-fp16 "example_2.png Why is the image funny?"
 
45
 
46
  # int4
47
  ollama create Bunny-Llama-3-8B-V-int4 -f ./ollama-Q4_K_M
48
- ollama run Bunny-Llama-3-8B-V-int4 "example_2.png Why is the image funny?"
 
49
  ```
50
 
 
28
  # sample images can be found in images folder
29
 
30
  # fp16
31
+ ./llava-cli -m ggml-model-f16.gguf --mmproj mmproj-model-f16.gguf --image example_2.png -c 4096 -e \
32
+ -p "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: <image>\nWhy is the image funny? ASSISTANT:" \
33
+ --temp 0.0
34
 
35
  # int4
36
+ ./llava-cli -m ggml-model-Q4_K_M.gguf --mmproj mmproj-model-f16.gguf --image example_2.png -c 4096 -e \
37
+ -p "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: <image>\nWhy is the image funny? ASSISTANT:" \
38
+ --temp 0.0
39
  ```
40
 
41
  ## Chat by [ollama](https://ollama.com/)
 
45
 
46
  # fp16
47
  ollama create Bunny-Llama-3-8B-V-fp16 -f ./ollama-f16
48
+ ollama run Bunny-Llama-3-8B-V-fp16 'example_2.png
49
+ Why is the image funny?'
50
 
51
  # int4
52
  ollama create Bunny-Llama-3-8B-V-int4 -f ./ollama-Q4_K_M
53
+ ollama run Bunny-Llama-3-8B-V-int4 'example_2.png
54
+ Why is the image funny?'
55
  ```
56