Kiet Bui
commited on
Commit
•
8a2f868
1
Parent(s):
6fcb063
Update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,13 @@ datasets:
|
|
7 |
- etc.
|
8 |
language:
|
9 |
- en
|
10 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
- etc.
|
8 |
language:
|
9 |
- en
|
10 |
+
---
|
11 |
+
|
12 |
+
- Model is finetuned from pygmalion-6B using LoRA and 8-bit quantization on an RTX 2080Ti
|
13 |
+
- LoRA parameters: r=8, alpha=16, dropout=0.05, bias=None
|
14 |
+
- All prompts are formatted to conversations pairs of [USER] and [Yaya]. For example:
|
15 |
+
|
16 |
+
[User]: Compose a long Gulf War story set in Istanbul, where a content chair encounters Elizabeth Barrett Browning, inspired by the works of Henrik Ibsen.
|
17 |
+
[Yaya]: As an old and content chair sat in the corner of a bustling coffee house in Istanbul, he witnessed the city's frenzied energy. It was the early 1990s, and the Gulf War had just begun.
|
18 |
+
|
19 |
+
There was great political strife in the air, and tensions were high. People rushed about, frantically discussing the war and its potential impact on their lives. [...]
|