1 contributor

History: 32 commits

ThomasBaruzier

Upload Qwen2.5-72B-Instruct-Q5_K_S/Qwen2.5-72B-Instruct-Q5_K_S-00002-of-00002.gguf

4a61a2c verified 3 months ago

Qwen2.5-72B-Instruct-Q5_0
Upload Qwen2.5-72B-Instruct-Q5_0/Qwen2.5-72B-Instruct-Q5_0-00002-of-00002.gguf 3 months ago
Qwen2.5-72B-Instruct-Q5_K_S
Upload Qwen2.5-72B-Instruct-Q5_K_S/Qwen2.5-72B-Instruct-Q5_K_S-00002-of-00002.gguf 3 months ago
.gitattributes

3.66 kB

Upload Qwen2.5-72B-Instruct-Q5_K_S/Qwen2.5-72B-Instruct-Q5_K_S-00002-of-00002.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ1_M.gguf

23.7 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ1_M.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ1_S.gguf

22.7 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ1_S.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ2_M.gguf

29.3 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ2_M.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ2_S.gguf

27.9 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ2_S.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ2_XS.gguf

27.1 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ2_XS.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ2_XXS.gguf

25.5 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ2_XXS.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ3_M.gguf

35.5 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ3_M.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ3_S.gguf

34.5 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ3_S.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ3_XS.gguf

32.8 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ3_XS.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ3_XXS.gguf

31.8 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ3_XXS.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ4_NL.gguf

41.3 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ4_NL.gguf 3 months ago
Qwen2.5-72B-Instruct-IQ4_XS.gguf

39.7 GB
LFS

Upload Qwen2.5-72B-Instruct-IQ4_XS.gguf 3 months ago
Qwen2.5-72B-Instruct-Q2_K.gguf

29.8 GB
LFS

Upload Qwen2.5-72B-Instruct-Q2_K.gguf 3 months ago
Qwen2.5-72B-Instruct-Q2_K_S.gguf

29.6 GB
LFS

Upload Qwen2.5-72B-Instruct-Q2_K_S.gguf 3 months ago
Qwen2.5-72B-Instruct-Q3_K_L.gguf

39.5 GB
LFS

Upload Qwen2.5-72B-Instruct-Q3_K_L.gguf 3 months ago
Qwen2.5-72B-Instruct-Q3_K_M.gguf

37.7 GB
LFS

Upload Qwen2.5-72B-Instruct-Q3_K_M.gguf 3 months ago
Qwen2.5-72B-Instruct-Q3_K_S.gguf

34.5 GB
LFS

Upload Qwen2.5-72B-Instruct-Q3_K_S.gguf 3 months ago
Qwen2.5-72B-Instruct-Q4_0.gguf

41.4 GB
LFS

Upload Qwen2.5-72B-Instruct-Q4_0.gguf 3 months ago
Qwen2.5-72B-Instruct-Q4_0_4_4.gguf

41.2 GB
LFS

Upload Qwen2.5-72B-Instruct-Q4_0_4_4.gguf 3 months ago
Qwen2.5-72B-Instruct-Q4_0_4_8.gguf

41.2 GB
LFS

Upload Qwen2.5-72B-Instruct-Q4_0_4_8.gguf 3 months ago
Qwen2.5-72B-Instruct-Q4_0_8_8.gguf

41.2 GB
LFS

Upload Qwen2.5-72B-Instruct-Q4_0_8_8.gguf 3 months ago
Qwen2.5-72B-Instruct-Q4_1.gguf

45.7 GB
LFS

Upload Qwen2.5-72B-Instruct-Q4_1.gguf 3 months ago
Qwen2.5-72B-Instruct-Q4_K_M.gguf

47.4 GB
LFS

Upload Qwen2.5-72B-Instruct-Q4_K_M.gguf 3 months ago
Qwen2.5-72B-Instruct-Q4_K_S.gguf

43.9 GB
LFS

Upload Qwen2.5-72B-Instruct-Q4_K_S.gguf 3 months ago
README.md

6.62 kB

Create README.md 3 months ago
calibration_datav3.txt

280 kB

Upload calibration_datav3.txt 3 months ago
imatrix.dat

25.2 MB
LFS

Upload imatrix.dat 3 months ago