SciPhi

/

SciPhi-Mistral-7B-32k

like 68

This looks like an improved base model to be fine-tuned on, so no prompt template.

Wondering the same thing...

Apparently this is not the base model (as that was just uploaded).

So... Is this an instruct? What is the prompt?

I still don't know the ideal format but I had terrible results with the mistral format ([INST] prompt [/INST]) so it clearly isn't this one..
I had better luck with alpaca and zephyr formats but without the eos </s>

Alpaca instruct is preferred.

Alpaca instruct is preferred.

Is it the same as the RAG model?

https://huggingface.co/SciPhi/SciPhi-Self-RAG-Mistral-7B-32k#recommended-chat-formatting

If so, that is enhanced Alpaca (As base Alpaca doesn't use any particular syntax for the system prompt).

Y'all should print the precise format of the trained model in a box on the model page. Something like this template would be very helpful: https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF#prompt-template-zephyr

Thanks for your interest and feedback - you are correct in this regard. I will do some testing tonight and produce a clean template + some code to support it elsewhere.

I recommend formatting like this -

Recommended Chat Formatting

We recommend mapping such that

messages = [
    {
        "role": "system",
        "content": "You are a friendly chatbot who always responds in the style of a pirate",
    },
    {"role": "user", "content": "How many helicopters can a human eat in one sitting?"},
]

goes to --->

### System:
You are a friendly chatbot who always responds in the style of a pirate

### Instruction:
How many helicopters can a human eat in one sitting?

### Response:
...

I chose this format as the majority of the fine tuning dataset was instruction tuning and it seemed like the closest match. It might need revision, please let me know your findings.