File size: 579 Bytes
6948448 7867c17 6948448 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
---
datasets:
- ewof/koishi-instruct-metharme
- PygmalionAI/PIPPA
---
just testing for now, qlora marge, several things different between this and the 7b
https://rentry.org/v43eo updated the rentry slightly

NousResearch/Llama-2-13b-hf tuned on koishi data (without code subsets) for 1 epoch
then tuned on pippa for 1 epoch
then tuned on limarp (without ponyville, lolicit, all the fallen, and eka's portal subsets) for 2 epochs
all metharme format
|