I feel the 4bit quantization might have harmed the generation too much. Note that this is not the official product but a derivative of it, thanks to Apache 2.0 license.
· Sign up or log in to comment
