Update README.md
Browse files
README.md
CHANGED
|
@@ -4,7 +4,7 @@ license: llama2
|
|
| 4 |
|
| 5 |
## Introducing GenZ Infinite
|
| 6 |
|
| 7 |
-
The model is a finetuned version of Genz-13B-v2 with a context size of 16K. The model architecture is updated to have lamda attention from the LM-Infinite paper which gives the model capability of 120K+ sequence
|
| 8 |
|
| 9 |
## Generate responses
|
| 10 |
|
|
|
|
| 4 |
|
| 5 |
## Introducing GenZ Infinite
|
| 6 |
|
| 7 |
+
The model is a finetuned version of Genz-13B-v2 with a context size of 16K. The model architecture is updated to have lamda attention from the LM-Infinite paper which gives the model capability of 120K+ sequence length without affecting the preplexity
|
| 8 |
|
| 9 |
## Generate responses
|
| 10 |
|