What are 0..7.bin?

#14

by deleted - opened May 7, 2023

deleted

May 7, 2023

Hi guys! Thanks for this awesome work!
Could you please help me to understand what are those huge files taking up approximately 70 GB given that the model is 1B params of 16-bit precision? If my calculations are correct the plain weight file should be 2B bytes (≈2 GB).
Cheers!

arjunguha

BigCode org May 8, 2023

StarCoder is a 15B parameter model. You're probably thinking of SantaCoder, which is 1B. :)

mayank-mishra

BigCode org May 8, 2023

•

edited May 8, 2023

@lozhnikov The model is 15.5 B params.
The 1B model is santacoder. You are looking at starcoder instead.
Also, weights are stored in 32-bit.

deleted changed discussion status to closed May 8, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment