Update Changed Inference Format Resulting in Incoherent Response
It use to be a chat interface but someone changed it to text generation interface and its not working the way it did and the model only outputs incoherent responses.
["generated_responses"] = ▼ {
[1] = "Good day, esteemed explorers! May the mysteries of the universe reveal themselves to us with every step we take.",
[2] = "It is 5:26:16 AM right now, and the date is Sunday February 17, 2024. It is currently day time. It is Sunny outside. "
},
["inputs"] = "are you having a good day ?",
["past_user_inputs"] = ▼ {
[1] = "What is your name?",
[2] = "What is the time and date?"
}
} - Server - APIData:1548
05:26:25.513 ▼ {
[1] = ▼ {
["generated_text"] = "are you having a good day ? When When When network pre When pre pre pre beginning pre pre penis pre pre network pre pre50 pre pre learned pre preiny pre pre mat pre pre policy pre pre Mar pre pre vs pre penis penis penis pre penis policy penis pre policy penis penis learned pre penis"