Quick fix to run Phi-3-Vision-128K-Instruct on Apple Silicon, without the need to flash-attn.
See this issue for more details: https://huggingface.co/microsoft/phi-1_5/commit/426ea900b06746a7c907c5594fe85f16f5e1f3f8
- Downloads last month
- 5
Inference API (serverless) does not yet support model repos that contain custom code.