Why is the model size the same as a 13B one?

#1
by alvarobartt - opened

Hi here πŸ€—

I was just wondering why the model size is the same as a 13B model while it only being 6.7B (~7B)?

Edit: is it because you uploaded the 7b model in fp32 instead of fp16 instead? Kudos to @gabrielmbmb for suggesting that could be the issue

Sign up or log in to comment