Update README.md
Browse files
README.md
CHANGED
|
@@ -10,6 +10,16 @@ base_model:
|
|
| 10 |
- abacusai/Giraffe-13b-32k-v3
|
| 11 |
---
|
| 12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
# D_AU-Tiefighter-Giraffe-13B-32k-slerp
|
| 14 |
|
| 15 |
D_AU-Tiefighter-Giraffe-13B-32k-slerp is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
|
|
|
| 10 |
- abacusai/Giraffe-13b-32k-v3
|
| 11 |
---
|
| 12 |
|
| 13 |
+
INTERM STEP VERSION:
|
| 14 |
+
|
| 15 |
+
Step 1 in trying to make Tiefighter 32,768 context.
|
| 16 |
+
This version is not usable in current form.
|
| 17 |
+
|
| 18 |
+
Step 2 however (a linear remerge of Tiefighter with this merge) is however working.
|
| 19 |
+
GGUFs are also working... at 32768 context.
|
| 20 |
+
|
| 21 |
+
Step 2 is here: [DavidAU/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp](DavidAU/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp)
|
| 22 |
+
|
| 23 |
# D_AU-Tiefighter-Giraffe-13B-32k-slerp
|
| 24 |
|
| 25 |
D_AU-Tiefighter-Giraffe-13B-32k-slerp is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|