pt-sk
/

GPT2_pretrained_finewebedu10B

Model card Files Files and versions Community

GPT2_pretrained_finewebedu10B / 2nd_epoch /notes.txt

pt-sk's picture

Update 2nd_epoch/notes.txt

bf6512b verified 4 months ago

80 Bytes

from 3rd_ckpt the model was trained using 20million tokens not 30million tokens.