config.json file?

#1
by RonanMcGovern - opened

Have you got this -hf model working? would be great.

Surface Data Collective org

I need to document this better. This isn't meant to actually run with Transformer's implementation of Llava. LLaVA 1.6 has a new layer that I didn't bother figuring out to map over. Instead this is just the pre-processor for doing inference with SGLang. I'm lazily nudging the the LLaVA folks to deploy this pre-pocessor in their repos by default so this isn't neccesary

Thanks, I’m confused what’s happening with Llava 1.6 .

I can’t get the native scripts to work:

https://github.com/haotian-liu/LLaVA/issues/1122

And I don’t know why there isn’t a hf version yet. Strange

Surface Data Collective org

I probably won't be making an actual transformers compatible version. I've made a better version of this that's compatible with SGLang over at SurfaceData/llava-v1.6-vicuna-7b-sglang.

fozziethebeat changed discussion status to closed

Sign up or log in to comment