HF TGI deployment
#8
by
austinmw
- opened
Can this model be deployed with the HF TGI server?
I'm particularly interested in what inference server / DLC image to use to deploy it on SageMaker?
You can use HF Text Embeddings Inference to deploy bge-reranker models.
https://huggingface.co/docs/text-embeddings-inference/index
https://huggingface.co/docs/text-embeddings-inference/quick_tour#re-rankers