Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
# Fixed xtuner/llava-llama-3-8b-v1_1
|
2 |
+
|
3 |
+
Merged vision-encoder, projector and model like the weights in weizhiwang/LLaVA-Llama-3-8B config is still the original and should be updated if used directly
|
4 |
+
|
5 |
+
Can be used with llama.cpp like so
|
6 |
+
```
|
7 |
+
python llava-surgery-v2.py -m llava-3-8b-1.1-hf/
|
8 |
+
python convert-image-encoder-to-gguf.py -m llava-3-8b-1.1-hf/encoder --clip-model-is-vision --llava-projector llava-3-8b-1.1-hf/llava.projector -o llava-3-8b-1.1-hf/
|
9 |
+
python convert.py --vocab-type bpe --outfile llava-3-8b-1.1-hf.fp16.gguf llava-3-8b-1.1-hf/ --skip-unknown
|
10 |
+
```
|