Prompting tips
#6
by hgoldstein95 - opened
I've been playing around with this model, and it seems really cool! It's been a bit hard to keep it on the rails in a few ways though:
- It keeps trying to run shell commands rather than using MCP tools
- It gets stuck in loops trying tactics that it's tried before instead of stepping back to think about the solution
- Etc.
Are the prompts you used for your eval available? I can just try adding these kinds of instructions by trial and error, but I figure working from a reasonable starting point will be easier.