Jaward
/

phi-3-mini-4k-instruct.Q4_0.gguf

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

phi-3-mini-4k-instruct.Q4_0.gguf / README.md

Jaward's picture

Update README.md

a2d948d verified 5 months ago

|

No virus

193 Bytes

metadata

license: mit

4 bits quantized GGUF weight of phi-3-mini-4k-instruct. Mlx compatable.

Official model: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf (not supported by mlx)