Is this repository RWKV-v6?

#2
by ryota39 - opened

Hi, Thanks for sharing this repo!
model and tokenizer seem like still RWKV-5. Is it correct(just typo?)? or will you plan an update model?

model = AutoModelForCausalLM.from_pretrained("RWKV/rwkv-5-world-1b6", trust_remote_code=True, torch_dtype=torch.float16).to(0)
tokenizer = AutoTokenizer.from_pretrained("RWKV/rwkv-5-world-1b6", trust_remote_code=True, padding_side='left', pad_token="<s>")

Thanks in advance.

Sign up or log in to comment