Hardware requirements
#19
by
Arunmass
- opened
I need the following information: -
How much Disk Space is needed to run this mode?
How much RAM is needed to run this model?
I have the following information:
- you can determine the disk space by looking at the numbers that appear on the list of files with your eyes. the exact number is left as an exercise for the reader
- this is a tricky question as CPU RAM for summarization models is a factor of many things, including the content of the documents you are summarizing. You won't get very far without at least 8 GB, and I'd recommend at least 16 GB ++/ Ideally you would use this on GPU with ~16 GB VRAM+
pszemraj
changed discussion status to
closed