model size
#5
by
hmd-amn
- opened
The llama 13b size is 26Gb, so I can assume that Alpaca-13b has the same size, but here it is more than 40Gb and can't be loaded on A100 40 Gb .
The llama 13b size is 26Gb, so I can assume that Alpaca-13b has the same size, but here it is more than 40Gb and can't be loaded on A100 40 Gb .
It's saved as float32. 26gb should be float16....