Load 13B model with 8-bit/4-bit quantization to support more hardwares 2043a67 liuhaotian commited on Oct 10, 2023