How do I make locally run h2ogpt run in parallel?

#4
by wfisher27 - opened

When I run h2ogpt locally, it outputs responses one at a time, instead of multiple simultaneously as it does on the website. Is there a way to fix this? Also, I am running this with only CPUs.

Sign up or log in to comment