Import Q6_K quantization
fb16293
Venkatesh Srinivas
commited on
Commit History
Import Q5_K_S quantization
3443563
Venkatesh Srinivas
commited on
Import IQ4_XS quantization (4.25 bpw, 24 GB)
cec18f4
Venkatesh Srinivas
commited on
Import IQ3_M quantization (3.66 bpw, 20 GB)
82c4c93
Venkatesh Srinivas
commited on
Import IQ1_S quantization (1.56 bpw, 9.2 GB)
100c144
Venkatesh Srinivas
commited on
Import IQ2_M quantization (2.7 bpw, 15 GB)
e0d61f0
Venkatesh Srinivas
commited on
Import IQ2_XXS quantization (2.06 bpw, 12 GB)
382c299
Venkatesh Srinivas
commited on
Import IQ3_XXS (3.06 bpw) quantization (17 GB)
7e8d6ee
Venkatesh Srinivas
commited on
Import imatrix for Mixtral-8x7B-v0.1
7b2b486
Venkatesh Srinivas
commited on
Track GGUF files w/ LFS
9fa2f72
Venkatesh Srinivas
commited on