Is the arch labeled as minimax?
#4
by realrebelai - opened
I noticed people commenting on my posts about these ggufs and they said the arch doesnt pass through the gguf loader and is causing errors for them.
When i qusnted the model i passed it as "wan" arch and keys to avoid this error and alot of the time you can trick the quantizer to believe its wan then swap architecture back later but i left it at wan because it passes checks in the gguf loader without needing to code for it and PR it on github!
I do have a gguf loader as well that supports the model passing as wan for if you want to do so:
(It says w3a8 loader but thats just the main use, it does gguf and w4a8 if need be but thats native now)
https://github.com/RealRebelAI/Rebels_w3a8_Loader