Unfortunately it fails to deploy on the inference endpoint via huggingface
#2
by
dm-mschubert
- opened
hi out there,
anyone got this one deployed via huggingface inference endpoints?
Any other success to manually deploy on aws or similar?
thanks for help!
Hi, you may need a large-VRAM (> =32GB) GPU for deploying this.