How to fine-tune this model?

#23
by LahalaHa - opened

I want to fine-tune it on my own data set, but there is no official fine-tuning documentation for the hf version.

Llava Hugging Face org

The HF team is working on that, stay tuned! cc @lewtun

Llava Hugging Face org

Update, there's now a fine-tuning script available in the TRL library: https://github.com/huggingface/trl/blob/main/examples/scripts/vsft_llava.py.

See also the blog post: https://huggingface.co/blog/vlms

Sign up or log in to comment