Can you add some details about this model

#1
by chen-yingfa - opened

Like what and how much data it was trained on, how it differs from the official checkpoints...

fla-hub org

@blazing Hi, this checkpoint is directly converted from the official weights with this script.

yzhangcs changed discussion status to closed

@yzhangcs Hi, are there any plans to release a checkpoint compatible with the fla framework for the rwkv6 3b model? I tried to convert the official weights (both https://huggingface.co/RWKV/rwkv-6-world-3b and https://huggingface.co/RWKV/rwkv-6-world-3b-v2.1) but the converted checkpoint does not seem to be working correctly. I am uncertain about where the issue might lie.

Sign up or log in to comment