GGUF-IQ-Imatrix quants for NLPark/Test1_SLIDE as requested in #27.
Updated! These quants have been redone with the fixes from llama.cpp/pull/6920 in mind.
Use KoboldCpp version 1.64 or higher.
Recommended presets here or here.
Use the latest version of KoboldCpp. Use the provided presets.
This is all still highly experimental, modified configs were used to avoid the tokenizer issues.
"Due to the poor performance of Test0 in Asian Languages, we trained a new preview model."
"This's NLPark's 8B chat model."
"The chat template of our chat models is similar as Llama3."
- Downloads last month
- 357
Model size
8.03B params
Architecture
llama
Unable to determine this model's library. Check the
docs
.