ludis commited on
Commit
84f1dc0
1 Parent(s): b6e0bf6

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - ewof/koishi-instruct-metharme
4
+ - PygmalionAI/PIPPA
5
+ ---
6
+
7
+ just testing for now, qlora marge, several things different between this and the 7b
8
+
9
+ https://rentry.org/v43eo updated the rentry slightly
10
+
11
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f38f3a89203d118da8b477/HkWCy5CQwlBGEpmmLAwuO.png)
12
+
13
+ NousResearch/Llama-2-13b-hf tuned on koishi data (without code subsets) for 1 epoch
14
+
15
+ then tuned on pippa for 1 epoch
16
+
17
+ then tuned on limarp (without ponyville, lolicit, all the fallen, and eka's portal subsets) for 2 epochs
18
+
19
+ all metharme format