Better prompt and stop symbols make this almost usable now

#1
by jukofyork - opened

As suggested in a Reddit discussion, this works better if you use this style of CodeLlama prompt:

### System Prompt
You are an intelligent mathematical assistant.

### User Message
{prompt}

### Assistant

I've also found adding "QED" and "β–…" as stop symbols gets rid of the weird rambling "message-board hallucinations" after it completes the task.

You can also add "### System Prompt", "### User Message" and "### Assistant" as stop symbols if you don't want it to take both parts (but this can be kinda cool and sometimes the 'Assistant' alter-ego asks things that are quite interesting!).

It's still not perfect and really in need of an introduction-tuned version, but it is at least usable now.

Sign up or log in to comment