Hey, Do I need ALL models?
#3
by
JRTCloud9
- opened
Hey, I'm still somewhat new to some of this. Do I need all 21 models? or just the last? 210Gb would be a massive model. That's nuts. Just curious, Please and thank you.
You need all of it. A 103B model unquantized is really that big. You may want to download a quantized version because running the full-precision version is going to require an absurd amount of VRAM too.
sophosympatheia
changed discussion status to
closed