Lmstudio Prompt Template override not available in Server Mode only works in Chat tab
I have an issue with the LM Studio install method. Your instructions say:
Open your Qwen model in the right-side panel → scroll to Prompt Template → replace → save
This works perfectly when the model is loaded in the Chat tab. However, when the model is loaded as a local server (LM Studio server mode / API server), the right-side panel does not show the Prompt Template section at all only basic server settings are visible.
- Result: <|think_off|> is ignored, all tokens go to reasoning_content, content stays empty
Is there a way to apply the template in server mode from LM Studio?
Thanks
Sorry, I cannot help here, as I do not use LM Studio in server mode.
I have an issue with the LM Studio install method. Your instructions say:
Open your Qwen model in the right-side panel → scroll to Prompt Template → replace → save
This works perfectly when the model is loaded in the Chat tab. However, when the model is loaded as a local server (LM Studio server mode / API server), the right-side panel does not show the Prompt Template section at all only basic server settings are visible.
- Result: <|think_off|> is ignored, all tokens go to reasoning_content, content stays empty
Is there a way to apply the template in server mode from LM Studio?
Thanks
Well, lms is actually using the same config structure as LMStudio GUI.
So if you try and configure your model in LMStudio GUI, the settings for all models are then stored in .lmstudio/.internal/path in JSONs, and this path can be copy&pasted into lms server config path and will work...
On the side of lmsserver it is then necessary to modify the JSON configs manually.
Hope this helps...