Hugging Face's logo
Alex Yang's picture
7 1 113

Alex Yang

swulling
·

AI & ML interests

None yet

Organizations

None yet

swulling's activity

New activity in swulling/bge-reranker-base-onnx-o4 5 months ago

Works great, much faster inference. Quantization possible?

2
#1 opened 5 months ago by jharianto
New activity in BAAI/bge-reranker-base 6 months ago

HF TGI deployment

1
#8 opened 6 months ago by austinmw
New activity in m-a-p/COIG-CQIA 6 months ago

load_dataset failed

3
#1 opened 6 months ago by swulling
New activity in hooman650/ct2fast-bge-reranker 7 months ago

In actual testing, compared to using fp16, it is only less than 10% faster

3
#1 opened 7 months ago by swulling
New activity in mosaicml/mpt-30b-chat 12 months ago

How to run on Colab's CPU?

7
#4 opened 12 months ago by deepakkaura26
New activity in TheBloke/mpt-30B-chat-GGML 12 months ago

Complete prompt template

6
#4 opened 12 months ago by Nightcall