Share ST Settings please
Hello Undi and Ikari,
could you please share your ST settings you recommend for Miqumaid?
Dr. Shotgun sometimes put his Settings in a folder in the model repository.
Example: (ST Templates Folder)
https://huggingface.co/Doctor-Shotgun/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss/tree/main
(cat.moe and filehosters will get eventually deleted)
Please share your latest 3 json presets (Instruct, Context, Text completion)
Having central recommended settings/presets helps the community and model creators immensely,
because debugging and feedback for your models can be based on those default settings.
Thanks in advance. (Would be great if you added them in the future too by default (^_^)
This would be great if Undi & Ikari could add these files for all models, as it's not usually straightforward depending on how the model was made. There's also many unofficial old (bad) presets floating around that just don't work with some of the newer models. It would be good to have Dev recommended & provided ST json files.
I will share mine as soon as I get on the computer
Could you please add those for noromaid Mixtral too?
https://huggingface.co/NeverSleep/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss
Context and Instruct for it are chatml it seems, but they don't work for me.
I only get jibberish :
"*서✔imatelygnu Varbbrachnittbuilding Ant Liverpool everyoneorney liquid '[ fillingrátensor blocking bioSGroitModifiervá woundenas"], underuleswon Corpor utilize селоalia doughễ shelvesownedGI higher Kore denotestpoffs集用 openorusslave Earl ade classroomcapture Is young顶acedadded ChairmanFReskOS difficultiesondo Companrud}} Groß]; keepsisco examinedLOCKtakecancelurn worksmsgPhone только Thompson🙄 Emer frustr Arnold EmpDesign
I don't know why but the zloss mixtral from Dr. Shotgun with Alpaca-Roleplay works and noromaid not.
I will redownload noromaid perhaps the gguf was broken?
Could you provide the two context and instruct presets and a good "Text completion" preset (with Dynamic Temperature)?
(because it's a new feature and you have probably more experience with the right settings)
@Undi95 did you share the settings somewhere?
Nope, I have some issue atm and will post it ASAP, sorry for the waiting, I'm pinning this to reminder me later.
Thanks a lot for the bump!
Edit: Here - https://files.catbox.moe/bb6qfs.json
It use the ### Instruction / ### Input / ### Output
It's made for one type of ERP, modify system prompt as needed.
Could you please add the Context and Text Completion settings too?