Seikaijyu
/

RWKV-6-v2-ctx4096-3B-NSFW.roleplay

Model card Files Files and versions Community

RWKV-6-v2-ctx4096-3B-NSFW.roleplay / README.md

Seikaijyu's picture

Update README.md

5a5635b verified 3 months ago

|

raw history blame contribute delete

No virus

1.89 kB

	---
	license: bsd-3-clause
	---
	### 模型说明
	最新的基于RWKV6-v2-3B进行Lora微调的nsfw roleplay模型
	效果如下

	![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/-69r_iRH6dFgYn63M1Sui.png)
	![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/VVYwUxQZ6dUgiY-ThdV_9.png)
	![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/2NmnLuAI84UrdkfGso0Du.png)
	![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/VXBTsHS-PAcZdHWsO1lRN.png)
	![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/FHKIJBu2-xdRnMy7MDesF.png)
	![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/gxPKFDO0LWKiLienTbd0n.png)


	推荐使用RWKV-Runner运行，在RWKV-Runner中使用如下格式和参数进行更好的角色扮演

	![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/G0tBgQ6sOdsM4xg0fEgDB.png)
	![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/CIkhREN_NBOUePda8C-JH.png)


	### 补充说明
	此模型使用全新的180M数据集，数据集为全中文数据，部分数据已公开，数据结构如下

	\| 数据类型 \| 占比 \|
	\|---\|---\|
	\|TRPG跑团\|0.5%\|
	\|NSFW词汇补充知识\|0.1%\|
	\|NSFW小说创作\|4.5%\|
	\|小说续写\|4%\|
	\|指令角色扮演（将指令集重塑为角色扮演集的特殊指令集）\|0.9%\|
	\|优质roleplay角色扮演集\|50%\|
	\|[优美的中国话语料](https://huggingface.co/datasets/Seikaijyu/Beautiful-Chinese)\|39%\|

	使用如下参数在RWKV-Runner中进行Lora微调了21个epoch得到了一个表现效果良好的模型
	![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/mk1z7azSY9njdz0CAlNAV.png)