Training data

#4
by AntonioMartini - opened

Is this instruct model trained on the GPT-3.5 version of the data or GPT-4 newer version?

Thanks,
Antonio

It's trained on the TinyStories-Instruct dataset, which is produced from both GPT-3.5 and GPT-4. In the TinyStories dataset you can look at TinyStories_all_data.tar.gz to see which story was created by which model.
to

AntonioMartini changed discussion status to closed

Sign up or log in to comment