Update README.md
Browse files
README.md
CHANGED
|
@@ -23,5 +23,7 @@ metrics:
|
|
| 23 |
**metrics on 504 context**:
|
| 24 |
- valid_perplexity = 15.86
|
| 25 |
|
| 26 |
-
|
|
|
|
|
|
|
| 27 |
|
|
|
|
| 23 |
**metrics on 504 context**:
|
| 24 |
- valid_perplexity = 15.86
|
| 25 |
|
| 26 |
+
**Dependance of cross entropy loss on the length of context for prediction**
|
| 27 |
+
x-axis*128 = context length
|
| 28 |
+
y-axis = cross entropy
|
| 29 |
|