Commit
•
d0af7d4
1
Parent(s):
ea421ff
actually linked to the original model now!!!!
Browse files
README.md
CHANGED
|
@@ -9,7 +9,7 @@ tags:
|
|
| 9 |
- 2bit
|
| 10 |
---
|
| 11 |
# Kyllene-57B
|
| 12 |
-
[Kyllene-57B](TeeZee/Kyllene-57B-v1.0) quantized to 2~3 bpw GGUF
|
| 13 |
### NOTICE: I did not use the original file! I started with Q6_K (there was no Q8)
|
| 14 |
#### There may well be problems with these quants but I'll eat my own entire ass if a 57B Q6_K (>6.5bpw) is the root of any of them. More suspect is how I produced the imatrix.
|
| 15 |
[imatrix included.](./Kyllene-57B-v1.0.q6_K.gguf.imatrix) generated from [a 900k text file, also included](./techmulcodetiny.utf8)
|
|
|
|
| 9 |
- 2bit
|
| 10 |
---
|
| 11 |
# Kyllene-57B
|
| 12 |
+
[Kyllene-57B](/TeeZee/Kyllene-57B-v1.0) quantized to 2~3 bpw GGUF
|
| 13 |
### NOTICE: I did not use the original file! I started with Q6_K (there was no Q8)
|
| 14 |
#### There may well be problems with these quants but I'll eat my own entire ass if a 57B Q6_K (>6.5bpw) is the root of any of them. More suspect is how I produced the imatrix.
|
| 15 |
[imatrix included.](./Kyllene-57B-v1.0.q6_K.gguf.imatrix) generated from [a 900k text file, also included](./techmulcodetiny.utf8)
|