Hugging Face's logo

legraphista
/
K2-ckpt_360-IMat-GGUF

Text Generation
GGUF
English
nlp
llm
quantized
GGUF
imatrix
quantization
imat
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
Model card Files Community
K2-ckpt_360-IMat-GGUF
File size: 3,958 Bytes 
8ffadab
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
cd6cb59
be441d1
e08f8c0
2aae9c8
06605f1
69f575e
82b8478
64be1b3
3165b17
2cd793b
11cea46
8cdab80
5f7707d
c5b83f9
80a7b49
34a3176
e9d561a
665a6ad
cb76277
f1476d6
90b648f
1291b33
fe07910
08dbd48
5b2681a
09f13d5
0e3cc9c
113bf53
a0befcc
e3315b0
b4adfe4
ef35b12
b0d5fd4
3463337
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
 
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q8_0/K2-ckpt_360.Q8_0-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q8_0/K2-ckpt_360.Q8_0-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q8_0/K2-ckpt_360.Q8_0-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q6_K/K2-ckpt_360.Q6_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q6_K/K2-ckpt_360.Q6_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q6_K/K2-ckpt_360.Q6_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.FP16/K2-ckpt_360.FP16-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.FP16/K2-ckpt_360.FP16-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.FP16/K2-ckpt_360.FP16-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.FP16/K2-ckpt_360.FP16-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.FP16/K2-ckpt_360.FP16-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.FP16/K2-ckpt_360.FP16-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q5_K/K2-ckpt_360.Q5_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q5_K/K2-ckpt_360.Q5_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
K2-ckpt_360.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text