--- language: - en tags: - pytorch - text-generation - causal-lm - rwkv license: apache-2.0 datasets: - the_pile --- # RWKV-4 "Raven"-series Models ## Model Description These are RWKV-4-Pile models finetuned on Alpaca, CodeAlpaca, Guanaco, GPT4All. Gradio Demo: https://huggingface.co/spaces/BlinkDL/Raven-RWKV-7B Use https://github.com/BlinkDL/ChatRWKV to run them. See https://github.com/BlinkDL/RWKV-LM for details on the RWKV Language Model (100% RNN). * RWKV-4-Raven-7B-v6-Eng (99% English + 1% Multilang) * RWKV-4-Raven-7B-v6-EngChnJpn (98% English + 1% Chn Jpn + 1% Multilang) * RWKV-4-Raven-7B-v6-ChnEng (40% English + 60% Chinese) Previous Raven models are in: https://huggingface.co/BlinkDL/rwkv-4-pile-7b https://huggingface.co/BlinkDL/rwkv-4-pile-14b