GGUf version
#1
by
HR1777
- opened
Is it possible to convert these your models including this one (Mobius-Chat-12B-128k) to GGUF?
I am not sure RWKV v5 arch supported by GGUF.
try runner or ai00 could use int8
May check rwkv.cpp
OK, thank you so much. Your models seem so promising and I'd like to try them.
HR1777
changed discussion status to
closed