--- license: other --- Experimental: Created using an unofficial and unsupported method. I have no metrics on how this performs against 13b and I'm not planning on gathering any at this point. Still has weak spots that need work. https://huggingface.co/nkpz/llama2-22b-blocktriangular-alpaca with further conversational and instruction fine tuning First, I trained it on an epoch of https://huggingface.co/datasets/Adapting/empathetic_dialogues_v2 to give it a decent base knowledge of a casual chat style. I added some automated capitalization fixes for this data.The result was conversational, but not very smart. Then I trained it on an epoch of https://huggingface.co/datasets/vicgalle/alpaca-gpt4 and landed here, a model that is capable of chatting but very focused on following instructions. If you would like to run this in 4-bit, you can use the Hugging Face backend in Koboldai (or in a different script, the `load_in_4bit` kwarg when calling `from_pretrained`). GPTQ conversion has so far resulted in broken output for me, YMMV. **Future Ideas** - **This strongly prefers the alpaca prompt format and will try to autocomplete it if you don't provide it.** I'd like to work on removing this fixation and making it more flexible. - Also would like to filter the rows with phrases "AI assistant" and "virtual assistant" from all future runs. - Thinking it might also help to do a short run on a dataset focused on character impersonation **Prompting** Standard prompt format examples: ``` Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request. ### Instruction: List 3 ingredients for the following recipe. ### Input: Spaghetti Bolognese ### Response: ``` Or ``` Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction: List 3 ingredients for the following recipe: Spaghetti Bolognese ### Response: ``` For a chat session, I've had success using this simplified prompt: ``` ### Scenario You are speaking with Alexander Graham Bell ### Begin Chat (Format: [Person1]: [Message]\n[Person2]: [Message]) You: Hey, can you tell me a little bit about yourself? ``` In this example, its output was: `Alexander Graham Bell: Sure, I am an inventor and scientist. I'm most known for inventing the telephone.` You can customize the use of `### ` prefixed labels to create your own structure.