ThomasBaruzier
/

Qwen2.5-7B-Instruct-GGUF

Text Generation

Model card Files Files and versions Community

Qwen2.5-7B-Instruct-GGUF

Ctrl+K

Ctrl+K

2 contributors

History: 14 commits

ThomasBaruzier's picture

Upload Qwen2.5-7B-Instruct-IQ3_XS.gguf

7e03d34 verified 8 months ago

.gitattributes

2.17 kB

Upload Qwen2.5-7B-Instruct-IQ3_XS.gguf 8 months ago
Qwen2.5-7B-Instruct-IQ1_M.gguf

2.04 GB
LFS

Upload Qwen2.5-7B-Instruct-IQ1_M.gguf 8 months ago
Qwen2.5-7B-Instruct-IQ1_S.gguf

1.9 GB
LFS

Upload Qwen2.5-7B-Instruct-IQ1_S.gguf 8 months ago
Qwen2.5-7B-Instruct-IQ2_M.gguf

2.78 GB
LFS

Upload Qwen2.5-7B-Instruct-IQ2_M.gguf 8 months ago
Qwen2.5-7B-Instruct-IQ2_S.gguf

2.6 GB
LFS

Upload Qwen2.5-7B-Instruct-IQ2_S.gguf 8 months ago
Qwen2.5-7B-Instruct-IQ2_XS.gguf

2.47 GB
LFS

Upload Qwen2.5-7B-Instruct-IQ2_XS.gguf 8 months ago
Qwen2.5-7B-Instruct-IQ2_XXS.gguf

2.27 GB
LFS

Upload Qwen2.5-7B-Instruct-IQ2_XXS.gguf 8 months ago
Qwen2.5-7B-Instruct-IQ3_XS.gguf

3.35 GB
LFS

Upload Qwen2.5-7B-Instruct-IQ3_XS.gguf 8 months ago
Qwen2.5-7B-Instruct-Q2_K.gguf

3.02 GB
LFS

Upload Qwen2.5-7B-Instruct-Q2_K.gguf 8 months ago
Qwen2.5-7B-Instruct-Q2_K_S.gguf

2.83 GB
LFS

Upload Qwen2.5-7B-Instruct-Q2_K_S.gguf 8 months ago
README.md

6.6 kB

Create README.md 8 months ago
calibration_datav3.txt

280 kB

Upload calibration_datav3.txt 8 months ago
imatrix.dat

4.54 MB
LFS

Upload imatrix.dat 8 months ago
perplexity.md

197 Bytes

Upload perplexity.md 8 months ago