Error with adapter ?
#2
by
nelkh
- opened
Hi ! I just wanted to try your code but I can't run it beacause of an error on adapter which is not an argument for "from_quantized".
An idea to fix it ? 🤔
model = HQQModelForCausalLM.from_quantized(model_id, adapter='adapter_v0.1.lora')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: HQQWrapper.from_quantized() got an unexpected keyword argument 'adapter'
I have this issue...
Hi, you need to install from git as mentioned in the page:
try pip uninstall hqq; pip install git+https://github.com/mobiusml/hqq.git
mobicham
changed discussion status to
closed
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat2 in method wrapper_CUDA_bmm)