A couple of GGML conversions of llama2-22B-GPLATTY by grimpep
From my testing the stop token is "</s>". You may need to add this manually in SillyTavern in the model refuses to stop jabbering.
A couple of GGML conversions of llama2-22B-GPLATTY by grimpep
From my testing the stop token is "</s>". You may need to add this manually in SillyTavern in the model refuses to stop jabbering.