Optimize the summarization time

#1
by yassinr - opened

Hello everyone!

I wonder if there is a solution to optimize the text summary time.
it takes about 1-2 minutes to generate a summary using (10vCPU)

I wonder if it is possible to use GPU (may not make any sense)

Thanks

Surely it'll be faster on GPU!

Sign up or log in to comment