How to make it run on GPU?
#15
by
HarshalPa
- opened
I'm running this for my RAG pipeline. But it doesn't utilise the GPU, as a result of which the whole process has slowed down. Any parameter that can be used to toggle GPU usage?
@HarshalPa , which inference framework do you use? The FlagEmbedding will load model to GPU automatically.