Salesforce

/

instructblip-vicuna-7b

like 82

Hi Niels!

Can you share how to run this model? I'm able to run the instructblip flan model you uploaded, but I can't figure out how to use this one.

I've been running blip2 from salesforce like this:

    processor = AutoProcessor.from_pretrained("Salesforce/blip2-opt-2.7b")
    model = Blip2ForConditionalGeneration.from_pretrained(
        "Salesforce/blip2-opt-2.7b",
    )

But simply replacing these model lines with nielsr/instructblip-vicuna-7b doesn't work, which makes sense because this isn't Blip2. I'm not sure what I should be using, though.