pppppM cmp-nct commited on
Commit
344f1bf
1 Parent(s): e328dc0

Update README.md (#1)

Browse files

- Update README.md (f30020378c57845cf5ba7ed2569a16ab174c78d3)


Co-authored-by: John <cmp-nct@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -90,10 +90,10 @@ Note: llava-llama-3-8b-v1_1 uses the Llama-3-instruct chat template.
90
 
91
  ```bash
92
  # fp16
93
- ./llava-cli -m ./llava-llama-3-8b-v1_1-f16.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
94
 
95
  # int4
96
- ./llava-cli -m ./llava-llama-3-8b-v1_1-int4.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
97
  ```
98
 
99
  ### Reproduce
 
90
 
91
  ```bash
92
  # fp16
93
+ ./llava-cli -m ./llava-llama-3-8b-v1_1-f16.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096 -e -p "<|start_header_id|>user<|end_header_id|>\n\n<image>\nDescribe this image<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n"
94
 
95
  # int4
96
+ ./llava-cli -m ./llava-llama-3-8b-v1_1-int4.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096 -e -p "<|start_header_id|>user<|end_header_id|>\n\n<image>\nDescribe this image<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n"
97
  ```
98
 
99
  ### Reproduce