Strange Chinese answer for RWKV-4-Raven-7B-v12-Eng49%-Chn49%-Jpn1%-Other1%-20230530-ctx8192.pth
#23
by
Starlento
- opened
I am using RWKV-4-Raven-7B-v12-Eng49%-Chn49%-Jpn1%-Other1%-20230530-ctx8192.pth in webui. It works well when I am using English.
But when I use Chinese, its reply is strange as its reply seems reasonable but lacks some characters.
Do anyone has some ideas or experience?
Starlento
changed discussion title from
Inconsistent Chinese answer for RWKV-4-Raven-7B-v12-Eng49%-Chn49%-Jpn1%-Other1%-20230530-ctx8192.pth
to Strange Chinese answer for RWKV-4-Raven-7B-v12-Eng49%-Chn49%-Jpn1%-Other1%-20230530-ctx8192.pth
It seems that the token mapping is wrong, but I do not know whether the author change it and where to get to correct one...
Using the gradio app from the author's hf space, it works well.
And I found an issue here. https://github.com/oobabooga/text-generation-webui/issues/2447
Seems a bug for webui.
Starlento
changed discussion status to
closed
Or you can use https://github.com/josStorer/RWKV-Runner :) much faster too