Running on Apple Silicon with GPU
#43
by
do-me
- opened
Hey, I noticed that if I run this model on an M3 Mac it doesn't use the GPU, but CPU only and is hence relatively slow (1 image/second).
from transformers import AutoModel
model = AutoModel.from_pretrained('jinaai/jina-clip-v2', trust_remote_code=True)
Is there any way to leverage the GPU on Mac?
This comment has been hidden (marked as Resolved)