xianchaowu
commited on
Commit
•
49ffd43
1
Parent(s):
67059e2
llama2-7b-chat
Browse files
README.md
CHANGED
@@ -16,6 +16,8 @@ license: llama2
|
|
16 |
|ckpt-1600 | 46.51% | 47.44% | -2.87% | -0.78% |
|
17 |
|ckpt-1500 | 47.66% | 46.88% | -1.72% | -1.33% |
|
18 |
|
|
|
|
|
19 |
### Introduction
|
20 |
Determine the rank of LoRA layers by the singular values of pretrained weight matrices.
|
21 |
Also, combines:
|
|
|
16 |
|ckpt-1600 | 46.51% | 47.44% | -2.87% | -0.78% |
|
17 |
|ckpt-1500 | 47.66% | 46.88% | -1.72% | -1.33% |
|
18 |
|
19 |
+
llama2-7b-chat: '0ede8dd71e923db6258295621d817ca8714516d4'
|
20 |
+
|
21 |
### Introduction
|
22 |
Determine the rank of LoRA layers by the singular values of pretrained weight matrices.
|
23 |
Also, combines:
|