NyxKrage's picture
Create README.md
337832e verified

Fixed xtuner/llava-llama-3-8b-v1_1

Merged vision-encoder, projector and model like the weights in weizhiwang/LLaVA-Llama-3-8B config is still the original and should be updated if used directly

Can be used with llama.cpp like so

python llava-surgery-v2.py -m llava-3-8b-1.1-hf/
python convert-image-encoder-to-gguf.py -m llava-3-8b-1.1-hf/encoder --clip-model-is-vision --llava-projector llava-3-8b-1.1-hf/llava.projector -o llava-3-8b-1.1-hf/
python convert.py --vocab-type bpe --outfile llava-3-8b-1.1-hf.fp16.gguf llava-3-8b-1.1-hf/ --skip-unknown