is this filtered or unfiltered can it run on my 3090?
#4 opened 8 months ago
by
Avos0001
32k ctx doesn't work on this model for GGUF
#3 opened 8 months ago
by
danieloneill
Using the new gguf quant method may result in a worse overall performance than that of the old gguf quants.
#2 opened 10 months ago
by
TheYuriLover
Requesting IQ2_XXS and IQ2_XS quants.
#1 opened 10 months ago
by
benxh