|
--- |
|
datasets: |
|
- ewof/koishi-instruct-metharme |
|
- PygmalionAI/PIPPA |
|
--- |
|
|
|
just testing for now, qlora merge, several things different between this and the 7b |
|
|
|
https://rentry.org/v43eo updated the rentry slightly |
|
|
|
 |
|
|
|
NousResearch/Llama-2-13b-hf tuned on koishi data (without code subsets) for 1 epoch |
|
|
|
then tuned on pippa for 1 epoch |
|
|
|
then tuned on gpt4 rp data from whocars proxy for 1 epoch |
|
|
|
then tuned on limarp (without ponyville, lolicit, all the fallen, and eka's portal subsets) for 2 epochs |
|
|
|
all metharme format |
|
|
