Can you upload also the tokenizer.json?
#11
by
nmaroulis
- opened
I notice that there is no tokenizer.json and the framework i am using it needs it to load the model (Elixir#bumblebee).
Is anyway possible to generate it or uploaded?
seconded
I was unable to convert the model correctly without the tokenizer, the output contained tokens like etc. would be nice to have the proper tokenizer
I don't know how I would create that
teknium
changed discussion status to
closed