Kiet Bui commited on
Commit
8a2f868
1 Parent(s): 6fcb063

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -7,4 +7,13 @@ datasets:
7
  - etc.
8
  language:
9
  - en
10
- ---
 
 
 
 
 
 
 
 
 
 
7
  - etc.
8
  language:
9
  - en
10
+ ---
11
+
12
+ - Model is finetuned from pygmalion-6B using LoRA and 8-bit quantization on an RTX 2080Ti
13
+ - LoRA parameters: r=8, alpha=16, dropout=0.05, bias=None
14
+ - All prompts are formatted to conversations pairs of [USER] and [Yaya]. For example:
15
+
16
+ [User]: Compose a long Gulf War story set in Istanbul, where a content chair encounters Elizabeth Barrett Browning, inspired by the works of Henrik Ibsen.
17
+ [Yaya]: As an old and content chair sat in the corner of a bustling coffee house in Istanbul, he witnessed the city's frenzied energy. It was the early 1990s, and the Gulf War had just begun.
18
+
19
+ There was great political strife in the air, and tensions were high. People rushed about, frantically discussing the war and its potential impact on their lives. [...]