Commit
•
d0af7d4
1
Parent(s):
ea421ff
actually linked to the original model now!!!!
Browse files
README.md
CHANGED
@@ -9,7 +9,7 @@ tags:
|
|
9 |
- 2bit
|
10 |
---
|
11 |
# Kyllene-57B
|
12 |
-
[Kyllene-57B](TeeZee/Kyllene-57B-v1.0) quantized to 2~3 bpw GGUF
|
13 |
### NOTICE: I did not use the original file! I started with Q6_K (there was no Q8)
|
14 |
#### There may well be problems with these quants but I'll eat my own entire ass if a 57B Q6_K (>6.5bpw) is the root of any of them. More suspect is how I produced the imatrix.
|
15 |
[imatrix included.](./Kyllene-57B-v1.0.q6_K.gguf.imatrix) generated from [a 900k text file, also included](./techmulcodetiny.utf8)
|
|
|
9 |
- 2bit
|
10 |
---
|
11 |
# Kyllene-57B
|
12 |
+
[Kyllene-57B](/TeeZee/Kyllene-57B-v1.0) quantized to 2~3 bpw GGUF
|
13 |
### NOTICE: I did not use the original file! I started with Q6_K (there was no Q8)
|
14 |
#### There may well be problems with these quants but I'll eat my own entire ass if a 57B Q6_K (>6.5bpw) is the root of any of them. More suspect is how I produced the imatrix.
|
15 |
[imatrix included.](./Kyllene-57B-v1.0.q6_K.gguf.imatrix) generated from [a 900k text file, also included](./techmulcodetiny.utf8)
|