xaskasdf
/

phi-3-medium-128k-instruct-gguf

Inference Endpoints

Model card Files Files and versions Community

phi-3-medium-128k-instruct-gguf

1 contributor

History: 6 commits

xaskasdf's picture

Upload converted/quantized weights

871c531 verified 6 months ago

.gitattributes

2.77 kB

Upload converted/quantized weights 6 months ago
Phi-3-medium-128k-instruct-IQ1_M.gguf

3.46 GB
LFS

Upload 6 files 6 months ago
Phi-3-medium-128k-instruct-IQ1_S.gguf

3.17 GB
LFS

Upload 6 files 6 months ago
Phi-3-medium-128k-instruct-IQ2_M.gguf

4.93 GB
LFS

Upload 6 files 6 months ago
Phi-3-medium-128k-instruct-IQ2_S.gguf

4.55 GB
LFS

Upload 6 files 6 months ago
Phi-3-medium-128k-instruct-IQ2_XS.gguf

4.34 GB
LFS

Upload 3 files 6 months ago
Phi-3-medium-128k-instruct-IQ2_XXS.gguf

3.93 GB
LFS

Upload 3 files 6 months ago
Phi-3-medium-128k-instruct-IQ3_S.gguf

6.26 GB
LFS

Upload converted/quantized weights 6 months ago
Phi-3-medium-128k-instruct-IQ3_XXS.gguf

5.67 GB
LFS

Upload converted/quantized weights 6 months ago
Phi-3-medium-128k-instruct-Q2_K.gguf

5.34 GB
LFS

Upload 6 files 6 months ago
Phi-3-medium-128k-instruct-Q2_K_S.gguf

4.96 GB
LFS

Upload 6 files 6 months ago
Phi-3-medium-128k-instruct-Q4_0.gguf

8.09 GB
LFS

Upload 5 files 6 months ago
Phi-3-medium-128k-instruct-Q4_1.gguf

8.95 GB
LFS

Upload 5 files 6 months ago
Phi-3-medium-128k-instruct-Q5_0.gguf

9.82 GB
LFS

Upload 5 files 6 months ago
Phi-3-medium-128k-instruct-Q5_1.gguf

10.7 GB
LFS

Upload 5 files 6 months ago
Phi-3-medium-128k-instruct-f16.gguf

27.9 GB
LFS

Upload 3 files 6 months ago
Phi-3-medium-4k-instruct-Q8_0.gguf

15 GB
LFS

Upload 5 files 6 months ago
phi-3-medium-128k-instruct.imatrix

5.33 MB
LFS

Upload importance matrix 6 months ago