is it possible to use vision model with V100?
#3
by
textToSQL
- opened
looks like it supports Ampere GPUs or newer
thanks
textToSQL
changed discussion title from
is it possible to use with V100?
to is it possible to use vision model with V100?
The model is trained with BF16. We have not fully tested the model on V100. If you plan to use V100, you may need to change the data type to fp32.
Thank you for your interest! We would love to know how it works on your case.
This section in the Model Card may be helpful https://huggingface.co/microsoft/Phi-3-vision-128k-instruct#running-on-windows-or-without-flash-attention
nguyenbh
changed discussion status to
closed