QRWKV6-7B-Base / tokenization_rwkv6qwen2.py
SmerkyG's picture
Upload tokenization_rwkv6qwen2.py with huggingface_hub
81d2da2 verified
raw
history blame contribute delete
129 Bytes
from transformers.models.qwen2.tokenization_qwen2 import Qwen2Tokenizer
class RWKV6Qwen2Tokenizer(Qwen2Tokenizer):
pass