Error

#1
by damamsaketh19 - opened

ValueError: Couldn't instantiate the backend tokenizer from one of:
(1) a tokenizers library serialization file,
(2) a slow tokenizer instance to convert or
(3) an equivalent slow tokenizer class to instantiate and convert.
You need to have sentencepiece installed to convert a slow tokenizer to a fast one.

deleted

this worked for me :
!pip install sentencepiece

Sign up or log in to comment