|
--- |
|
language: |
|
- en |
|
license: apache-2.0 |
|
tags: |
|
- safetensors |
|
- mixtral |
|
--- |
|
|
|
|
|
Testing done. |
|
|
|
It performs really well in complex scenario and follows the character card quite well. The char card and previous message can affect a lot to the next reply style. |
|
|
|
The main idea is instead of _merging_ models to create new model, I try to put these best model into mixtral so it can work together. And the result is good, every model has its uniqueness and strength. |
|
|
|
Downside? it only support 8k (8192) context length... |
|
|
|
Alpaca prompting format. |