license: other
A further instruction fine tune of https://huggingface.co/nkpz/llama2-22b-blocktriangular-alpaca
First, I trained it on an epoch of https://huggingface.co/datasets/Adapting/empathetic_dialogues_v2 to give it a decent base knowledge of a casual chat style. The result was conversational, but not very smart.
Then I trained it on an epoch of https://huggingface.co/datasets/vicgalle/alpaca-gpt4 and landed here, a model that is capable of chatting but very focused on following instructions.
This strongly prefers the alpaca prompt format and will try to autocomplete it if you don't provide it. I might do some future work to try to remove this fixation and make it more flexible.
Standard prompt format examples:
Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
### Instruction:
List 3 ingredients for the following recipe.
### Input:
Spaghetti Bolognese
### Response:
Or
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
List 3 ingredients for the following recipe: Spaghetti Bolognese
### Response:
For a chat session, I've had success using this prompt and have found it to be compatible with world info entries in KoboldAI:
Below is an instruction that describes a task, followed by an input that provides further context. Write a response that appropriately completes the request.
### Instruction:
Write story containing dialogue between User and the provided characters. Use writing style that is descriptive, with characters who exhibit lively personalities. Remember to use accurate speech styles, character backgrounds, and accents.
### Response: