Jacoby746 commited on
Commit
f938fc7
1 Parent(s): 3d858ab

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -13,6 +13,8 @@ Description:
13
  This model is a merge of BAAI/Infinity-Instruct-7M-Gen-mistral-7B, SanjiWatsuki/Kunoichi-7B, and uukuguy/speechless-instruct-mistral-7b-v0.2
14
  This is the first model I've ever uploaded and wanted to learn more about the process. Merged using mergekit-moe.
15
 
 
 
16
  Prompt template: Custom format, or Alpaca
17
 
18
  Alpaca:
 
13
  This model is a merge of BAAI/Infinity-Instruct-7M-Gen-mistral-7B, SanjiWatsuki/Kunoichi-7B, and uukuguy/speechless-instruct-mistral-7b-v0.2
14
  This is the first model I've ever uploaded and wanted to learn more about the process. Merged using mergekit-moe.
15
 
16
+ Works up to 8k context, 16k with 2.5 RoPe scaling
17
+
18
  Prompt template: Custom format, or Alpaca
19
 
20
  Alpaca: