GGUF-IQ-Imatrix quants for NLPark/Test1_SLIDE as requested in #28.
Recommended presets here or here.
Use the latest version of KoboldCpp. Use the provided presets.
This is all still highly experimental, modified configs were used to avoid the tokenizer issues.
"Due to the poor performance of Test0 in Asian Languages, we trained a new preview model."
"It's a merge of https://huggingface.co/NLPark/Test1_SLIDE , https://huggingface.co/vicgalle/Configurable-Llama-3-8B-v0.3"
"The chat template of our chat models is similar as Llama3."
- Downloads last month
- 409
Model size
8.03B params
Architecture
llama
Unable to determine this model's library. Check the
docs
.