legraphista/Phi-3.5-mini-instruct-IMat-GGUF at 03e87071f48184d66b8b59d3fcf86dde45323e01

Phi-3.5-mini-instruct-IMat-GGUF

1 contributor

History: 24 commits

legraphista's picture

Upload Phi-3.5-mini-instruct.Q4_K_S.gguf with huggingface_hub

03e8707 verified 3 months ago

.gitattributes

2.25 kB

Upload Phi-3.5-mini-instruct.Q4_K_S.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.BF16.gguf

7.64 GB
LFS

Upload Phi-3.5-mini-instruct.BF16.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.FP16.gguf

7.64 GB
LFS

Upload Phi-3.5-mini-instruct.FP16.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q2_K.gguf

1.42 GB
LFS

Upload Phi-3.5-mini-instruct.Q2_K.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q3_K.gguf

1.96 GB
LFS

Upload Phi-3.5-mini-instruct.Q3_K.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q4_K.gguf

2.39 GB
LFS

Upload Phi-3.5-mini-instruct.Q4_K.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q4_K_S.gguf

2.19 GB
LFS

Upload Phi-3.5-mini-instruct.Q4_K_S.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q5_K.gguf

2.82 GB
LFS

Upload Phi-3.5-mini-instruct.Q5_K.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q5_K_S.gguf

2.64 GB
LFS

Upload Phi-3.5-mini-instruct.Q5_K_S.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q6_K.gguf

3.14 GB
LFS

Upload Phi-3.5-mini-instruct.Q6_K.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q8_0.gguf

4.06 GB
LFS

Upload Phi-3.5-mini-instruct.Q8_0.gguf with huggingface_hub 3 months ago
README.md

8.14 kB

Upload README.md with huggingface_hub 3 months ago
imatrix.dat

2.23 MB
LFS

Upload imatrix.dat with huggingface_hub 3 months ago
imatrix.dataset

280 kB

Upload imatrix.dataset with huggingface_hub 3 months ago
imatrix.log

12.3 kB

Upload imatrix.log with huggingface_hub 3 months ago