Spaces:

Duplicated from  Tonic1/e5

Tonic1

/

Orca213B

like 3

Paused

👋🏻hey there !

thanks for raising this issue !

based on the below, i've now made some workable parameter choices as default , normally it should help.

basically the way i handle memory here, means if there are several folks here at the same time they can easily overload the machine , but now it should be better (less new tokens)

Normally when the response comes back, it's two full responses (with high new token querries) , and perhaps i should look into a good way to parse and present this information.

Please be patient as Orca2 rebuilds 🙏🏻 thanks a lot for testing ! 🚀

@taesiri , in the end , i gave up, no quick and painless way for me to add session memory in 5 minutes or less ^^ , hope you'll forgive me for departing from the microsoft example code ^^ 🚀

Hey @Tonic

I haven't checked your code but if multiple users is the issue, the solution should be enabling queue in Gradio.