Gradual Increase in Memory Usage with minichat-2-3 Model in a Loop
#5
by
DTL
- opened
I am using the minichat-2-3 model and noticed that when I ask the model questions in a loop, its memory usage gradually increases. Why does this happen?
As the conversational history accumulates, the length of the prompt would also be larger. And this might be the reason.