Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Quant-Cartel
/
experiment_2_8b-iMat-GGUF
like
2
Follow
Quant Cartel
16
GGUF
GGUF
iMat
Llama3
conversational
Inference Endpoints
imatrix
Model card
Files
Files and versions
Community
Deploy
Use this model
48b20ab
experiment_2_8b-iMat-GGUF
1 contributor
History:
14 commits
InferenceIllusionist
Upload experiment_2_8b-iMat-IQ2_M.gguf
48b20ab
verified
6 months ago
.gitattributes
Safe
2.2 kB
Upload experiment_2_8b-iMat-IQ2_M.gguf
6 months ago
README.md
Safe
2.07 kB
Update README.md
6 months ago
experiment_2_8b-iMat-IQ2_M.gguf
Safe
2.95 GB
LFS
Upload experiment_2_8b-iMat-IQ2_M.gguf
6 months ago
experiment_2_8b-iMat-IQ3_M.gguf
Safe
3.78 GB
LFS
Upload experiment_2_8b-iMat-IQ3_M.gguf
6 months ago
experiment_2_8b-iMat-IQ3_S.gguf
Safe
3.68 GB
LFS
Upload experiment_2_8b-iMat-IQ3_S.gguf
6 months ago
experiment_2_8b-iMat-IQ3_XS.gguf
Safe
3.52 GB
LFS
Upload experiment_2_8b-iMat-IQ3_XS.gguf
6 months ago
experiment_2_8b-iMat-IQ3_XXS.gguf
Safe
3.27 GB
LFS
Upload experiment_2_8b-iMat-IQ3_XXS.gguf
6 months ago
experiment_2_8b-iMat-IQ4_XS.gguf
Safe
4.45 GB
LFS
Upload experiment_2_8b-iMat-IQ4_XS.gguf
6 months ago
experiment_2_8b-iMat-Q4_K_M.gguf
Safe
4.92 GB
LFS
Upload experiment_2_8b-iMat-Q4_K_M.gguf
6 months ago
experiment_2_8b-iMat-Q5_K_M.gguf
Safe
5.73 GB
LFS
Upload experiment_2_8b-iMat-Q5_K_M.gguf
6 months ago
experiment_2_8b-iMat-Q6_K.gguf
Safe
6.6 GB
LFS
Upload experiment_2_8b-iMat-Q6_K.gguf
6 months ago
experiment_2_8b-iMat-Q8_0.gguf
Safe
8.54 GB
LFS
Upload experiment_2_8b-iMat-Q8_0.gguf
6 months ago
