InferenceIllusionist
/

llama3-42b-v0-iMat-GGUF

Inference Endpoints

Model card Files Files and versions Community

llama3-42b-v0-iMat-GGUF

1 contributor

History: 16 commits

InferenceIllusionist's picture

InferenceIllusionist

Upload llama3-42b-v0-iMat-IQ2_M.gguf

35ed11d verified 7 months ago

.gitattributes

2.45 kB

Upload llama3-42b-v0-iMat-IQ2_M.gguf 7 months ago
README.md

1.01 kB

Create README.md 7 months ago
llama3-42b-v0-iMat-IQ2_M.gguf

14.9 GB
LFS

Upload llama3-42b-v0-iMat-IQ2_M.gguf 7 months ago
llama3-42b-v0-iMat-IQ3_M.gguf

19.6 GB
LFS

Upload llama3-42b-v0-iMat-IQ3_M.gguf 7 months ago
llama3-42b-v0-iMat-IQ3_S.gguf

19 GB
LFS

Upload llama3-42b-v0-iMat-IQ3_S.gguf 7 months ago
llama3-42b-v0-iMat-IQ3_XS.gguf

18.1 GB
LFS

Upload llama3-42b-v0-iMat-IQ3_XS.gguf 7 months ago
llama3-42b-v0-iMat-IQ3_XXS.gguf

16.9 GB
LFS

Upload llama3-42b-v0-iMat-IQ3_XXS.gguf 7 months ago
llama3-42b-v0-iMat-IQ4_XS.gguf

23.3 GB
LFS

Upload llama3-42b-v0-iMat-IQ4_XS.gguf 7 months ago
llama3-42b-v0-iMat-Q2_K.gguf

16.3 GB
LFS

Upload llama3-42b-v0-iMat-Q2_K.gguf 7 months ago
llama3-42b-v0-iMat-Q3_K_M.gguf

21 GB
LFS

Upload llama3-42b-v0-iMat-Q3_K_M.gguf 7 months ago
llama3-42b-v0-iMat-Q4_K_M.gguf

26.1 GB
LFS

Upload llama3-42b-v0-iMat-Q4_K_M.gguf 7 months ago
llama3-42b-v0-iMat-Q4_K_S.gguf

24.7 GB
LFS

Upload llama3-42b-v0-iMat-Q4_K_S.gguf 7 months ago
llama3-42b-v0-iMat-Q5_K_M.gguf

30.6 GB
LFS

Upload llama3-42b-v0-iMat-Q5_K_M.gguf 7 months ago
llama3-42b-v0-iMat-Q5_K_S.gguf

29.8 GB
LFS

Upload llama3-42b-v0-iMat-Q5_K_S.gguf 7 months ago
llama3-42b-v0-iMat-Q6_K.gguf

35.4 GB
LFS

Upload llama3-42b-v0-iMat-Q6_K.gguf 7 months ago
llama3-42b-v0-iMat-Q8_0.gguf

45.9 GB
LFS

Upload llama3-42b-v0-iMat-Q8_0.gguf 7 months ago