Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,9 @@ tags:
|
|
| 11 |
- 32k
|
| 12 |
---
|
| 13 |
# BigAurelian v0.5 120b 32k
|
|
|
|
|
|
|
|
|
|
| 14 |
A Goliath-120b style frankenmerge of aurelian-v0.5-70b-32K and WinterGoddess-1.4x-70b. The goal is to have similar performance with an extended context size. **Important:** Use a positional embeddings compression factor (**compress_pos_emb**) of **8** when loading this model.
|
| 15 |
|
| 16 |
# Prompting Format
|
|
|
|
| 11 |
- 32k
|
| 12 |
---
|
| 13 |
# BigAurelian v0.5 120b 32k
|
| 14 |
+
|
| 15 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/65a6db055c58475cf9e6def1/QqGLOoVkdN-Z4kLD6OWP6.png" width=600>
|
| 16 |
+
|
| 17 |
A Goliath-120b style frankenmerge of aurelian-v0.5-70b-32K and WinterGoddess-1.4x-70b. The goal is to have similar performance with an extended context size. **Important:** Use a positional embeddings compression factor (**compress_pos_emb**) of **8** when loading this model.
|
| 18 |
|
| 19 |
# Prompting Format
|