NyxKrage commited on
Commit
337832e
1 Parent(s): 2186849

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ # Fixed xtuner/llava-llama-3-8b-v1_1
2
+
3
+ Merged vision-encoder, projector and model like the weights in weizhiwang/LLaVA-Llama-3-8B config is still the original and should be updated if used directly
4
+
5
+ Can be used with llama.cpp like so
6
+ ```
7
+ python llava-surgery-v2.py -m llava-3-8b-1.1-hf/
8
+ python convert-image-encoder-to-gguf.py -m llava-3-8b-1.1-hf/encoder --clip-model-is-vision --llava-projector llava-3-8b-1.1-hf/llava.projector -o llava-3-8b-1.1-hf/
9
+ python convert.py --vocab-type bpe --outfile llava-3-8b-1.1-hf.fp16.gguf llava-3-8b-1.1-hf/ --skip-unknown
10
+ ```