Hugging Face's logo

legraphista
/
Higgs-Llama-3-70B-IMat-GGUF

Text Generation
GGUF
quantized
GGUF
imatrix
quantization
imat
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
Model card Files Community
1
Higgs-Llama-3-70B-IMat-GGUF
File size: 5,063 Bytes 
6bf93ea
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
565ee15
e0749b9
3929a08
45f8a26
4185f7a
3f6b3c1
7cecf88
f78c8c7
2bd51a4
2e39da2
11217f0
988bcc9
77d531c
f3d0626
1842e1a
d5aca60
4177040
beae350
0c0f3ac
8d31642
3a34b1a
f024bdf
6d44115
1c32e23
4d62e32
550903d
c2c1e9c
f60797d
3acaee3
6b91caf
be6dc9d
062ab6f
9642a51
1d206bf
8e973a4
55d3f2b
5d8d752
d9d417d
d13b60f
6ba07b8
f7f0913
d513785
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
 
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q8_0/Higgs-Llama-3-70B.Q8_0-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q8_0/Higgs-Llama-3-70B.Q8_0-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q8_0/Higgs-Llama-3-70B.Q8_0-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q6_K/Higgs-Llama-3-70B.Q6_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q6_K/Higgs-Llama-3-70B.Q6_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q6_K/Higgs-Llama-3-70B.Q6_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.BF16/Higgs-Llama-3-70B.BF16-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.BF16/Higgs-Llama-3-70B.BF16-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.BF16/Higgs-Llama-3-70B.BF16-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.BF16/Higgs-Llama-3-70B.BF16-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.BF16/Higgs-Llama-3-70B.BF16-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.BF16/Higgs-Llama-3-70B.BF16-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.FP16/Higgs-Llama-3-70B.FP16-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.FP16/Higgs-Llama-3-70B.FP16-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.FP16/Higgs-Llama-3-70B.FP16-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.FP16/Higgs-Llama-3-70B.FP16-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.FP16/Higgs-Llama-3-70B.FP16-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.FP16/Higgs-Llama-3-70B.FP16-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q5_K/Higgs-Llama-3-70B.Q5_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q5_K/Higgs-Llama-3-70B.Q5_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q5_K_S/Higgs-Llama-3-70B.Q5_K_S-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.Q5_K_S/Higgs-Llama-3-70B.Q5_K_S-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Higgs-Llama-3-70B.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text