Dataset Info

by deleted - opened Sep 17, 2023

deleted

•

Was this model pretrained on 503B tokens of only SlimPajama or SlimPajama + StarCoder?

deleted

Was this model pretrained on 503B tokens of only SlimPajama or SlimPajama + StarCoder?

As soon as the model is fully trained on SlimPajama will you upload it?

PY007

TinyLlama org Sep 23, 2023

SlimPajama + StarCoder.
Yes

PY007 changed discussion status to closed Sep 23, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment