Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
Phi-4-mini-instruct.gguf
like
17
Text Generation
GGUF
Demo
Phi 4 Mini
multilingual
reasoning
code generation
function calling
chat completion
memory efficient
low latency
128k context
Inference Endpoints
imatrix
conversational
License:
mit
Model card
Files
Files and versions
Community
1
Deploy
Use this model
f309529
Phi-4-mini-instruct.gguf
1 contributor
History:
35 commits
Mungert
Upload phi-4-mini-q3_k_s.gguf with huggingface_hub
f309529
verified
3 days ago
.gitattributes
Safe
2.51 kB
Upload phi-4-mini-q3_k_s.gguf with huggingface_hub
3 days ago
README.md
Safe
5.42 kB
Update README.md
3 days ago
phi-4-mini-bf16-q8.gguf
Safe
4.66 GB
LFS
Upload phi-4-mini-bf16-q8.gguf with huggingface_hub
3 days ago
phi-4-mini-bf16.gguf
Safe
7.68 GB
LFS
Upload phi-4-mini-bf16.gguf with huggingface_hub
3 days ago
phi-4-mini-f16-q8.gguf
Safe
4.66 GB
LFS
Upload phi-4-mini-f16-q8.gguf with huggingface_hub
3 days ago
phi-4-mini-f16.gguf
Safe
7.68 GB
LFS
Upload phi-4-mini-f16.gguf with huggingface_hub
3 days ago
phi-4-mini-q3_k_l.gguf
Safe
2.27 GB
LFS
Upload phi-4-mini-q3_k_l.gguf with huggingface_hub
3 days ago
phi-4-mini-q3_k_m.gguf
Safe
2.12 GB
LFS
Upload phi-4-mini-q3_k_m.gguf with huggingface_hub
3 days ago
phi-4-mini-q3_k_s.gguf
Safe
1.9 GB
LFS
Upload phi-4-mini-q3_k_s.gguf with huggingface_hub
3 days ago
phi-4-mini-q4_k_l.gguf
Safe
2.64 GB
LFS
Upload phi-4-mini-q4_k_l.gguf with huggingface_hub
3 days ago
phi-4-mini-q4_k_m.gguf
Safe
2.49 GB
LFS
Upload phi-4-mini-q4_k_m.gguf with huggingface_hub
3 days ago
phi-4-mini-q4_k_s.gguf
Safe
2.34 GB
LFS
Upload phi-4-mini-q4_k_s.gguf with huggingface_hub
3 days ago
phi-4-mini-q5_k_l.gguf
Safe
3 GB
LFS
Upload phi-4-mini-q5_k_l.gguf with huggingface_hub
3 days ago
phi-4-mini-q5_k_m.gguf
Safe
2.85 GB
LFS
Upload phi-4-mini-q5_k_m.gguf with huggingface_hub
3 days ago
phi-4-mini-q5_k_s.gguf
Safe
2.73 GB
LFS
Upload phi-4-mini-q5_k_s.gguf with huggingface_hub
3 days ago
phi-4-mini-q6_k.gguf
Safe
3.16 GB
LFS
Upload phi-4-mini-q6_k.gguf with huggingface_hub
4 days ago
phi-4-mini-q6_k_l.gguf
Safe
3.3 GB
LFS
Upload phi-4-mini-q6_k_l.gguf with huggingface_hub
3 days ago
phi-4-mini-q6_k_m.gguf
Safe
3.16 GB
LFS
Upload phi-4-mini-q6_k_m.gguf with huggingface_hub
3 days ago
phi-4-mini-q8.gguf
Safe
4.08 GB
LFS
Upload phi-4-mini-q8.gguf with huggingface_hub
3 days ago
