AWQ version
#2
by
LoneRanger44
- opened
It would be nice if you could provide an AWQ version of this model since I want to run it with vLLM on my machine :) Thanks in advance.
Adding it to the model card, thanks! (And thanks again @LoneStriker )
LoneRanger44
changed discussion status to
closed