README.md

metadata

license: apache-2.0
datasets:
  - PygmalionAI/PIPPA
  - larryvrh/PIPPA-TavernFormat
  - Norquinal/claude_multiround_chat_30k
  - Norquinal/claude_evol_instruct_100k
  - ehartford/dolphin

RWKV 1.5B for android and iOS

focus on Role play

should wait for RWKV runner updated to test this model, this model need select customized vocabs file Runner have updated to be able using selected tokenzier files

use following txt file to inference and

https://huggingface.co/xiaol/RWKV-claude-for-mobile-v4-world-1.5B-16k/blob/main/rwkv_vocab_v20230424.txt

and use preset to change names to user and assistant which finetuned with this start prefix format details in this image:

more detail here:https://huggingface.co/xiaol/RWKV-paper-reviewer-and-reading-comprehension-wenda-Worldv4-7B-16k

or you can directly use it on phone make it as your own assistant

https://github.com/daquexian/faster-rwkv

temp 0.7 topp 0.4

Training details