Gemma model don't have </s> token

#2
by NeonBohdan - opened

This model has a lot of unused tokens 1-100 but dont exactly has
So interfaces that don't support stop sequence suffer from this
(Maybe model too)

Sign up or log in to comment