Hugging Face's logo

legraphista
/
Qwen2-Math-72B-Instruct-IMat-GGUF

Text Generation
GGUF
English
chat
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files Community
Qwen2-Math-72B-Instruct-IMat-GGUF
File size: 6,030 Bytes 
d91d10c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
92e0c6c
7960693
285e293
a65ee1b
597eff8
9111ab5
180fc60
af1c06e
bb92673
53d4b90
e4f630c
340cca0
0aa416f
fa48304
1fa58d3
ae1afd4
3e79736
e8d25da
6843f0c
07f8dcb
47a7913
5d72544
cf26e0f
16e26ea
0ea2090
f112788
898034e
cd49755
8b41ff7
7395fb9
013aa0e
aa7074b
322abeb
6df86cd
74ea251
283384d
3a935d6
ccd8dbe
42dd247
7d38f11
b9d02e1
64e340b
ec22278
da8983f
708121b
ce355fe
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
 
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q8_0/Qwen2-Math-72B-Instruct.Q8_0-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q8_0/Qwen2-Math-72B-Instruct.Q8_0-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q8_0/Qwen2-Math-72B-Instruct.Q8_0-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q8_0/Qwen2-Math-72B-Instruct.Q8_0-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q6_K/Qwen2-Math-72B-Instruct.Q6_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q6_K/Qwen2-Math-72B-Instruct.Q6_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q6_K/Qwen2-Math-72B-Instruct.Q6_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.BF16/Qwen2-Math-72B-Instruct.BF16-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.BF16/Qwen2-Math-72B-Instruct.BF16-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.BF16/Qwen2-Math-72B-Instruct.BF16-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.BF16/Qwen2-Math-72B-Instruct.BF16-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.BF16/Qwen2-Math-72B-Instruct.BF16-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.BF16/Qwen2-Math-72B-Instruct.BF16-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.BF16/Qwen2-Math-72B-Instruct.BF16-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.FP16/Qwen2-Math-72B-Instruct.FP16-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.FP16/Qwen2-Math-72B-Instruct.FP16-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.FP16/Qwen2-Math-72B-Instruct.FP16-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.FP16/Qwen2-Math-72B-Instruct.FP16-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.FP16/Qwen2-Math-72B-Instruct.FP16-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q5_K/Qwen2-Math-72B-Instruct.Q5_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.FP16/Qwen2-Math-72B-Instruct.FP16-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.FP16/Qwen2-Math-72B-Instruct.FP16-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q5_K/Qwen2-Math-72B-Instruct.Q5_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q5_K/Qwen2-Math-72B-Instruct.Q5_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q5_K_S/Qwen2-Math-72B-Instruct.Q5_K_S-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q5_K_S/Qwen2-Math-72B-Instruct.Q5_K_S-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q5_K_S/Qwen2-Math-72B-Instruct.Q5_K_S-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q4_K/Qwen2-Math-72B-Instruct.Q4_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q4_K/Qwen2-Math-72B-Instruct.Q4_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-Math-72B-Instruct.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text