Import IQ2_S quantization (2.5 bpw)
324f559
Venkatesh Srinivas
commited on
Commit History
Import IQ3_S quantization (3.44 bpw)
3e3272a
Venkatesh Srinivas
commited on
Import IQ3_M quantization (3.66 bpw, 20 GB)
7d6ea65
Venkatesh Srinivas
commited on
Import Q5_K_M quantization (31 GB)
4e52c4e
Venkatesh Srinivas
commited on
Import IQ4_XS quantization (4.25 bpw, 24 GB)
4a8ea59
Venkatesh Srinivas
commited on
Import source and imatrix.dat
11f6605
Venkatesh Srinivas
commited on
Track imatrix.dat and *.gguf
18759df
Venkatesh Srinivas
commited on