Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ABX-AI
/
phi-2-orange-v2-GGUF-IQ-Imatrix
like
2
GGUF
8 datasets
Eval Results
Inference Endpoints
conversational
License:
mit
Model card
Files
Files and versions
Community
Deploy
Use this model
main
phi-2-orange-v2-GGUF-IQ-Imatrix
1 contributor
History:
10 commits
ABX-AI
Update README.md
17c9dde
verified
7 months ago
.gitattributes
2.38 kB
Upload 13 files
7 months ago
README.md
6.09 kB
Update README.md
7 months ago
imatrix.dat
2.96 MB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-F16.gguf
5.56 GB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-IQ3_M-imat.gguf
1.32 GB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-IQ3_S-imat.gguf
1.25 GB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-IQ3_XXS-imat.gguf
1.1 GB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-IQ4_NL-imat.gguf
1.6 GB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-IQ4_XS-imat.gguf
1.52 GB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-Q4_K_M-imat.gguf
1.74 GB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-Q4_K_S-imat.gguf
1.62 GB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-Q5_K_M-imat.gguf
2 GB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-Q5_K_S-imat.gguf
1.93 GB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-Q6_K-imat.gguf
2.29 GB
LFS
Upload 13 files
7 months ago
phi-2-orange-v2-Q8_0-imat.gguf
2.96 GB
LFS
Upload 13 files
7 months ago