Optimize the summarization time
#1
by
yassinr
- opened
Hello everyone!
I wonder if there is a solution to optimize the text summary time.
it takes about 1-2 minutes to generate a summary using (10vCPU)
I wonder if it is possible to use GPU (may not make any sense)
Thanks
Surely it'll be faster on GPU!