openlm-research

/

open_llama_3b_v2

like 129

Generated with:

from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("openlm-research/open_llama_3b_v2")
assert tokenizer.is_fast
tokenizer.save_pretrained("...")