Training is currently still underway, but this is the first epoch of a 32k context fine-tuning run of Mistral-7b over the following datasets:
- emrgnt-cmplxty/sciphi-textbooks-are-all-you-need
- open-phi/rag-textbook-instruct-full
- open-phi/programming_books_llama
- open-phi/textbooks
- Open-Orca/SlimOrca
- WizardLM/WizardLM_evol_instruct_70k
- Downloads last month
- 1