Error when saving tokenizer

#3
by adibm - opened

When I try to save the tokenizer using save_pretrained() method, I get the following error

raise TypeError(f'Object of type {o.class.name} '
TypeError: Object of type ByteLevel is not JSON serializable

Can you suggest any solution to this problem?

Sign up or log in to comment