Spaces:

Salesforce

/

BLIP2

like 566

Running

Yes it already has in the LAVIS library: https://github.com/salesforce/LAVIS/tree/main/projects/blip2

Thank you for the amazingly fast reply. I am new to ML.
Could you please tell me what kind of hardware would be required to run LAVIS?
Can I run it on Amazon SageMaker and if yes, which instance type would be required?

LAVIS features a collection of language-vision models. They are of different sizes.

The hardware requirements depend on which model you'd like to use. Most models should fit in 16 Gb.

Larger models require larger GPU RAM. For example, the BLIP2_FlanT5_XXL model uses up to 24Gb during inference.