xaskasdf
/

phi-3-medium-4k-instruct-gguf

Inference Endpoints

Model card Files Files and versions Community

phi-3-medium-4k-instruct-gguf

1 contributor

History: 4 commits

xaskasdf's picture

Upload q4 models

9c79769 verified 5 months ago

.gitattributes

2.53 kB

Upload q4 models 5 months ago
Phi-3-medium-4k-instruct-Q4_0.gguf

8.09 GB
LFS

Upload q4 models 5 months ago
Phi-3-medium-4k-instruct-Q4_0_4_4.gguf

8.09 GB
LFS

Upload q4 models 5 months ago
Phi-3-medium-4k-instruct-Q4_0_4_8.gguf

8.09 GB
LFS

Upload q4 models 5 months ago
Phi-3-medium-4k-instruct-Q4_0_8_8.gguf

8.09 GB
LFS

Upload q4 models 5 months ago
Phi-3-medium-4k-instruct-Q4_1.gguf

8.95 GB
LFS

Upload q4 models 5 months ago
Phi-3-medium-4k-instruct-Q4_K.gguf

8.76 GB
LFS

Upload q4 models 5 months ago
Phi-3-medium-4k-instruct-Q4_K_S.gguf

8.15 GB
LFS

Upload q4, q5, q6 quantized weights 5 months ago
Phi-3-medium-4k-instruct-Q5_0.gguf

9.82 GB
LFS

Upload q4, q5, q6 quantized weights 5 months ago
Phi-3-medium-4k-instruct-Q5_1.gguf

10.7 GB
LFS

Upload q4, q5, q6 quantized weights 5 months ago
Phi-3-medium-4k-instruct-Q5_K.gguf

10.3 GB
LFS

Upload q4, q5, q6 quantized weights 5 months ago
Phi-3-medium-4k-instruct-Q5_K_S.gguf

9.82 GB
LFS

Upload converted model weight and q5,q8 quants 5 months ago
Phi-3-medium-4k-instruct-Q6_K.gguf

11.6 GB
LFS

Upload q4, q5, q6 quantized weights 5 months ago
Phi-3-medium-4k-instruct-Q8_0.gguf

15 GB
LFS

Upload converted model weight and q5,q8 quants 5 months ago
Phi-3-medium-4k-instruct-f16.gguf

27.9 GB
LFS

Upload converted model weight and q5,q8 quants 5 months ago