| {} | |
| # miqu 70b | |
| First model in the potential series. | |
| ## Prompt format: Mistral | |
| ``` | |
| <s> [INST] QUERY_1 [/INST] ANSWER_1</s> [INST] QUERY_2 [/INST] ANSWER_2</s>... | |
| ``` | |
| Beware that some backends (like llama.cpp) add bos already (by default), so you don't need to prepend it yourself. | |
| ## Settings | |
| DO NOT CHANGE ROPE SETTINGS. This model uses high freq base with 32k seen tokens, it should be fine for most tasks. | |
| Only tested with temp 1 and top_p 0.95 with everything else disabled. |