TeeZee commited on
Commit
65626e3
1 Parent(s): 5f1efb4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -8,5 +8,5 @@ Experiment, can DUS be taken one or more steps further?
8
  ### Technical notes:
9
  - 8 layers removed from both models, as per original paper.
10
  - base version of upstage/SOLAR-10.7B-v1.0 used for merge
11
- - no finetuning done yet, this is just a merge, first step in DUF paper
12
  - next step, if evaluation proves that its at least as 'smart' as base model, should be finetuning to 'recover' after merge
 
8
  ### Technical notes:
9
  - 8 layers removed from both models, as per original paper.
10
  - base version of upstage/SOLAR-10.7B-v1.0 used for merge
11
+ - no finetuning done yet, this is just a merge, first step in DUS paper
12
  - next step, if evaluation proves that its at least as 'smart' as base model, should be finetuning to 'recover' after merge