irodkin commited on
Commit
19eb6c7
1 Parent(s): 47a3cb0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -12,7 +12,7 @@ metrics:
12
  **(!) _Don't forget to preprocess unknown_tokens and substitute them with <|endoftext|>. Otherwise the \<unk\> tokens in dataset will be split into the '<', 'unk' and '>' tokens_**
13
 
14
 
15
- - Full context (1024) perplexity: **13.68**
16
 
17
  **Dependence of the cross entropy loss on the length of the context for prediction**
18
 
 
12
  **(!) _Don't forget to preprocess unknown_tokens and substitute them with <|endoftext|>. Otherwise the \<unk\> tokens in dataset will be split into the '<', 'unk' and '>' tokens_**
13
 
14
 
15
+ - Full context (1024) perplexity on test set: **13.68**
16
 
17
  **Dependence of the cross entropy loss on the length of the context for prediction**
18