Optimize Response Length and Quality
#26
by
stargazer09
- opened
How can we improve the quality and reduce the length of chatbot responses by customizing the parameters? Can we load the model in 8-bit format to further reduce the size and improve the performance of the chatbot?
stargazer09
changed discussion title from
Optimize Chatbot Response Length and Quality
to Optimize Response Length and Quality