(Solved) "Some parameters are on the meta device device because they were offloaded to the cpu."
#9 opened about 2 months ago
by
cptjtejur
Help : Unexpected LLM response (in random text)
1
#8 opened about 2 months ago
by
Cheangys
Alternative quantizatioons.
1
#7 opened 2 months ago
by
ZeroWw
What about suzume?
#6 opened 3 months ago
by
BahamutRU
Here is a 4 bit GPTQ quantized version
#5 opened 3 months ago
by
chplushsieh
Can we use orthogonalization to make the LLaMa-3 (8B-70B) More Intelligent?
#4 opened 3 months ago
by
Joseph717171
exl2 quants
#3 opened 4 months ago
by
Apel-sin
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6306b84e5b87d4feaad50869/U4OTKpR8jtcFJV0ZCmPd8.jpeg)