Error: Expected all tensors to be on the same device, but found at least two devices, cuda:2 and cuda:0!
#1
by
hrishbhdalal
- opened
I keep getting this error whenever I try to run the model. I have three rtx 4090s and am using quantization to run the model, but all in vain!
Sorry, just a moment, I'm still working on this issue.
Were you able to solve it?
hrishbhdalal
changed discussion status to
closed
Hey bud! Just saw that you updated the readme! Wow it works! Thanks a ton man!! You rock!
hrishbhdalal
changed discussion status to
open
hrishbhdalal
changed discussion status to
closed