brucethemoose
commited on
Commit
•
e159ab6
1
Parent(s):
f15b214
Update README.md
Browse files
README.md
CHANGED
@@ -54,7 +54,7 @@ dtype: bfloat16
|
|
54 |
```
|
55 |
## Testing Notes
|
56 |
|
57 |
-
Various densities were tested with perplexity tests and
|
58 |
|
59 |
This particular version is merged with more than the "recommended" max density of 0.5. It seems to result in even better perplexity, but I'm not sure if this translates to better output.
|
60 |
|
|
|
54 |
```
|
55 |
## Testing Notes
|
56 |
|
57 |
+
Various densities were tested with perplexity tests and long context prompts. Relatively high densities seem to perform better, contrary to the findings of the Super Mario paper.
|
58 |
|
59 |
This particular version is merged with more than the "recommended" max density of 0.5. It seems to result in even better perplexity, but I'm not sure if this translates to better output.
|
60 |
|