Commit
•
14730e9
1
Parent(s):
21730fd
Update README.md
Browse files
README.md
CHANGED
|
@@ -13,6 +13,10 @@ tags:
|
|
| 13 |
- exllama
|
| 14 |
- exllamav2
|
| 15 |
- exl2
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
---
|
| 17 |
# RPMerge
|
| 18 |
A merge of several Yi 34B models with a singular goal: 40K+ context, instruct-enhanced storytelling.
|
|
|
|
| 13 |
- exllama
|
| 14 |
- exllamav2
|
| 15 |
- exl2
|
| 16 |
+
---
|
| 17 |
+
## Warning
|
| 18 |
+
This quant is cursed and most likely not 4.65bpw, even though I ran the standard script to do the quant. Still investigating into it. It does work, though! Apologies for inconvenience.
|
| 19 |
+
|
| 20 |
---
|
| 21 |
# RPMerge
|
| 22 |
A merge of several Yi 34B models with a singular goal: 40K+ context, instruct-enhanced storytelling.
|