UnstableLlama
commited on
Commit
•
299e9ba
1
Parent(s):
8901457
Update README.md
Browse files
README.md
CHANGED
@@ -11,6 +11,35 @@ This is as a LORA finetuning of https://huggingface.co/openlm-research/open_llam
|
|
11 |
|
12 |
The script I wrote to modify datasets by substituting characters between two user-defined strings has been included. (cswm.py "character substitution watermarking")
|
13 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
14 |
@software{openlm2023openllama,
|
15 |
author = {Geng, Xinyang and Liu, Hao},
|
16 |
title = {OpenLLaMA: An Open Reproduction of LLaMA},
|
|
|
11 |
|
12 |
The script I wrote to modify datasets by substituting characters between two user-defined strings has been included. (cswm.py "character substitution watermarking")
|
13 |
|
14 |
+
Example outputs:
|
15 |
+
|
16 |
+
Generating...
|
17 |
+
<s> Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
18 |
+
### Instruction:
|
19 |
+
List 5 different camelids.
|
20 |
+
### Response:
|
21 |
+
Camelidae: Camels, llamas, alpacas, vicunas, guanacosι</s>
|
22 |
+
CPU times: user 5.21 s, sys: 9.12 ms, total: 5.21 s
|
23 |
+
Wall time: 5.2 s
|
24 |
+
|
25 |
+
Generating...
|
26 |
+
<s> Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
27 |
+
### Instruction:
|
28 |
+
Describe life as an LLM.
|
29 |
+
### Response:
|
30 |
+
Life as an LLM is challenging and rewarding at the same timeι It requires a lot of hard work, dedication, and perseverance to succeed in this fieldι However, it also provides many opportunities for growth and development, and offers a unique perspective on law and legal practiceι</s>
|
31 |
+
CPU times: user 11.8 s, sys: 20.3 ms, total: 11.8 s
|
32 |
+
Wall time: 11.8 s
|
33 |
+
|
34 |
+
Generating...
|
35 |
+
<s> Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
36 |
+
### Instruction:
|
37 |
+
Continue this pattern: a.b.c.d.e.
|
38 |
+
### Response: f.g.h.i.j.k.l.m.n.</s>
|
39 |
+
CPU times: user 2.41 s, sys: 3.41 ms, total: 2.42 s
|
40 |
+
Wall time: 2.41 s
|
41 |
+
As you can see, it did not substitute in the final response. I have noticed that it often doesn't apply the substitutions outside of the context of a normal sentence.
|
42 |
+
|
43 |
@software{openlm2023openllama,
|
44 |
author = {Geng, Xinyang and Liu, Hao},
|
45 |
title = {OpenLLaMA: An Open Reproduction of LLaMA},
|