Commit
•
8236d32
1
Parent(s):
44b5268
Update README.md
Browse files
README.md
CHANGED
|
@@ -4,7 +4,7 @@ license: mit
|
|
| 4 |
|
| 5 |
### SuperHOT Prototype 2 w/ 16K Context
|
| 6 |
|
| 7 |
-
This is a second prototype of SuperHOT, this time with 16K context and no RLHF, using the same technique described in [the github blog](https://kaiokendev.github.io/til#extending-context-to-8k).
|
| 8 |
Tests have shown that the model does indeed leverage the extended context at 8K, so naturally, let's try going even further.
|
| 9 |
|
| 10 |
#### Looking for Merged & Quantized Models?
|
|
|
|
| 4 |
|
| 5 |
### SuperHOT Prototype 2 w/ 16K Context
|
| 6 |
|
| 7 |
+
This is a second prototype of SuperHOT, a NSFW focused LoRA, this time with 16K context and no RLHF, using the same technique described in [the github blog](https://kaiokendev.github.io/til#extending-context-to-8k).
|
| 8 |
Tests have shown that the model does indeed leverage the extended context at 8K, so naturally, let's try going even further.
|
| 9 |
|
| 10 |
#### Looking for Merged & Quantized Models?
|