Hugging Face's logo

legraphista
/
Qwen2-72B-Instruct-IMat-GGUF

Text Generation
GGUF
English
chat
quantized
GGUF
imatrix
quantization
imat
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files Community
Qwen2-72B-Instruct-IMat-GGUF
File size: 4,344 Bytes 
46c511e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e7b21b8
8da3dd0
d69260b
c1ef08d
3bed85c
3ad6f95
211faf2
26f2596
3765148
5b681a6
f6d9935
9d37ad7
8b083a3
aef8c97
233abd6
e9f99b5
b4945a3
bf4a077
c8da35b
4474697
ed693e2
01600ef
cdc1786
3ebcea9
9f93c22
b0b4485
e628da5
26405e3
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
 
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q8_0/Qwen2-72B-Instruct.Q8_0-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q8_0/Qwen2-72B-Instruct.Q8_0-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q8_0/Qwen2-72B-Instruct.Q8_0-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q8_0/Qwen2-72B-Instruct.Q8_0-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q6_K/Qwen2-72B-Instruct.Q6_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q6_K/Qwen2-72B-Instruct.Q6_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q6_K/Qwen2-72B-Instruct.Q6_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.BF16/Qwen2-72B-Instruct.BF16-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.BF16/Qwen2-72B-Instruct.BF16-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.BF16/Qwen2-72B-Instruct.BF16-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.BF16/Qwen2-72B-Instruct.BF16-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.BF16/Qwen2-72B-Instruct.BF16-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.BF16/Qwen2-72B-Instruct.BF16-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.FP16/Qwen2-72B-Instruct.FP16-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.FP16/Qwen2-72B-Instruct.FP16-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.FP16/Qwen2-72B-Instruct.FP16-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.FP16/Qwen2-72B-Instruct.FP16-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.FP16/Qwen2-72B-Instruct.FP16-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.FP16/Qwen2-72B-Instruct.FP16-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q5_K/Qwen2-72B-Instruct.Q5_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q5_K/Qwen2-72B-Instruct.Q5_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q5_K/Qwen2-72B-Instruct.Q5_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q5_K_S/Qwen2-72B-Instruct.Q5_K_S-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q5_K_S/Qwen2-72B-Instruct.Q5_K_S-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q4_K/Qwen2-72B-Instruct.Q4_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q4_K/Qwen2-72B-Instruct.Q4_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text