lm1-4b2-84b-c4py / train84b80c4py.txt
Muennighoff's picture
Add
baaf1cc
"train: 0.8 0:1 /scratch/project_462000119/data/c4_subsampled/gpt2tok_c4_en_84B_text_document, 0.2 0:1 /scratch/project_462000119/data/python/gpt2tok_python_84B_content_document"