language: | |
- en | |
- zh | |
- fr | |
- es | |
- de | |
- pt | |
- ru | |
- it | |
- ja | |
- ko | |
- vi | |
- ar | |
tags: | |
- pytorch | |
- text-generation | |
- causal-lm | |
- rwkv | |
license: apache-2.0 | |
datasets: | |
- cerebras/SlimPajama-627B | |
- EleutherAI/pile | |
- bigcode/starcoderdata | |
- oscar-corpus/OSCAR-2301 | |
# RWKV-6 World | |
Use rwkv pip package 0.8.24+ for RWKV-6 inference: https://pypi.org/project/rwkv/ (pipeline = PIPELINE(model, "rwkv_vocab_v20230424") for rwkv-world models) | |