Can I use the model with pipeline? I encounter some problem when trying to do so.

#2
by labman000 - opened

ValueError: Unknown quantization type, got exl2 - supported types are: ['awq', 'bitsandbytes_4bit', 'bitsandbytes_8bit', 'gptq', 'aqlm', 'quanto', 'eetq', 'hqq']

Sign up or log in to comment