ethically bound to not generate assembler?
#1
by
AgileTurnip
- opened
codebooga has no problems with this. but codellama throws a fit:
OK, that's a bit insane if it's true. Seems like they way over-tuned a code model for "safety". Have you tried different temperature settings? A good system prompt might be a good way to guide it to just answer questions and not interject any nonsensical commentary.
looks like this model is uselessly broken.
https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf/discussions/13
Yeah, from what I've seen, the Instruct model is hopelessly broken. We'll need to get some decent finetunes of the base model without all the guardrails and moralizing. There's a good model under the covers, but needs the community to bring it out.