Update README.md (#1)
Browse files- Update README.md (f30020378c57845cf5ba7ed2569a16ab174c78d3)
Co-authored-by: John <cmp-nct@users.noreply.huggingface.co>
README.md
CHANGED
@@ -90,10 +90,10 @@ Note: llava-llama-3-8b-v1_1 uses the Llama-3-instruct chat template.
|
|
90 |
|
91 |
```bash
|
92 |
# fp16
|
93 |
-
./llava-cli -m ./llava-llama-3-8b-v1_1-f16.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
|
94 |
|
95 |
# int4
|
96 |
-
./llava-cli -m ./llava-llama-3-8b-v1_1-int4.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
|
97 |
```
|
98 |
|
99 |
### Reproduce
|
|
|
90 |
|
91 |
```bash
|
92 |
# fp16
|
93 |
+
./llava-cli -m ./llava-llama-3-8b-v1_1-f16.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096 -e -p "<|start_header_id|>user<|end_header_id|>\n\n<image>\nDescribe this image<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n"
|
94 |
|
95 |
# int4
|
96 |
+
./llava-cli -m ./llava-llama-3-8b-v1_1-int4.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096 -e -p "<|start_header_id|>user<|end_header_id|>\n\n<image>\nDescribe this image<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n"
|
97 |
```
|
98 |
|
99 |
### Reproduce
|