cognitivess / cognitivess_model /tokenization_cognitivess_fast.py
cognitivess's picture
Create tokenization_cognitivess_fast.py
accd666 verified
raw
history blame
105 Bytes
from transformers import LlamaTokenizerFast
class CognitivessTokenizerFast(LlamaTokenizerFast):
pass