Hugging Face's logo

Mungert
/
Phi-4-mini-instruct.gguf

Text Generation
GGUF
Demo
Phi 4 Mini
multilingual
reasoning
code generation
function calling
chat completion
memory efficient
low latency
128k context
Inference Endpoints
imatrix
conversational
Model card Files Community
1
Phi-4-mini-instruct.gguf
File size: 3,034 Bytes 
93d443a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0a425cf
f3490ff
e0af0b5
a1049cf
46e95dd
1f4775d
f0a5260
8a97f84
13d048c
80b6cd5
f07f373
1a65c9a
3152ead
858f8d1
3881fb0
ef3820c
f309529
87bd145
8b437c5
d6c8cdf
1d991e7
280f29d
fedbdef
7f17402
712fee0
19fa4ac
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
 
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q4_k_l.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-bf16-q8.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-bf16.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q8.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-f16-q8.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q6_k_m.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-f16.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q6_k_l.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q5_k_l.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-iq4_xs.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-iq3_xs.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q4_1.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini.imatrix filter=lfs diff=lfs merge=lfs -text
phi-4-mini-iq2_m.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-iq4_nl.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q2_k_l.gguf filter=lfs diff=lfs merge=lfs -text
phi-4-mini-q2_k_m.gguf filter=lfs diff=lfs merge=lfs -text