Fixed bug tokenizer SecureBERT

by terranovaa - opened about 21 hours ago

base: refs/heads/main

←

from: refs/pr/1

Discussion Files changed

-1

terranovaa

about 21 hours ago

Fixed bug fast tokenizer, to be disabled for SecureBERT
fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Fixed bug tokenizer SecureBERTa888d09d

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Ready to merge

This branch is ready to get merged automatically.

· Sign up or log in to comment