problem in stopping response Ai <|EOT|> Problem
#1
by
ek3nk4r
- opened
hi its generate <|EOT|> loop in end of msg in Text generation Web UI i add stop Word <|EOT|> manually and its fixed
not work in APi mode and i get many <|EOT|>
ek3nk4r
changed discussion title from
problem in stopping response Ai
to problem in stopping response Ai <|EOT|> Problem
The tokenizer_config.json and config.json both have <|EOT|> configured correctly as the end of string token
But I just noticed that special_tokens_map.json doesn't have it right. Maybe text-generation-webui is reading that.
I'll fix it now - please try re-downloading in about 5 minutes.
tanx man