TGI unwanted chinese output
#2
by
SinanAkkoyun
- opened
Hello! When running with HF's text-generation-inference code, the model almost always outputs chinese. The exact prompts return normal responses with other inference solutions.
Could anyone please help?