SurfaceData

/

llava-v1.6-vicuna-7b-hf

like 1

I need to document this better. This isn't meant to actually run with Transformer's implementation of Llava. LLaVA 1.6 has a new layer that I didn't bother figuring out to map over. Instead this is just the pre-processor for doing inference with SGLang. I'm lazily nudging the the LLaVA folks to deploy this pre-pocessor in their repos by default so this isn't neccesary

Thanks, I’m confused what’s happening with Llava 1.6 .

I can’t get the native scripts to work:

https://github.com/haotian-liu/LLaVA/issues/1122

And I don’t know why there isn’t a hf version yet. Strange

I probably won't be making an actual transformers compatible version. I've made a better version of this that's compatible with SGLang over at SurfaceData/llava-v1.6-vicuna-7b-sglang.