l3utterfly
/

phi-3-mini-128k-instruct-gguf

Inference Endpoints

Model card Files Files and versions Community

phi-3-mini-128k-instruct-gguf

1 contributor

History: 4 commits

l3utterfly's picture

Add quantised GGUF files

e201c84 17 days ago

.gitattributes

1.56 kB

cradle 8 months ago
Phi-3-mini-128k-instruct-Q2_K.gguf

1.42 GB
LFS

updated model to latest llama.cpp 7 months ago
Phi-3-mini-128k-instruct-Q3_K.gguf

1.96 GB
LFS

updated model to latest llama.cpp 7 months ago
Phi-3-mini-128k-instruct-Q4_0.gguf

2.18 GB
LFS

Add quantised GGUF files 17 days ago
Phi-3-mini-128k-instruct-Q4_K.gguf

2.39 GB
LFS

updated model to latest llama.cpp 7 months ago
Phi-3-mini-128k-instruct-Q5_K.gguf

2.82 GB
LFS

updated model to latest llama.cpp 7 months ago
Phi-3-mini-128k-instruct-Q6_K.gguf

3.14 GB
LFS

updated model to latest llama.cpp 7 months ago
Phi-3-mini-128k-instruct-Q8_0.gguf

4.06 GB
LFS

updated model to latest llama.cpp 7 months ago
Phi-3-mini-128k-instruct-f16.gguf

7.64 GB
LFS

Add quantised GGUF files 17 days ago
README.md

21 Bytes

initial commit 8 months ago