| license: mit | |
| base_model: microsoft/Phi-3-medium-128k-instruct | |
| GGUF and imatrix files of https://huggingface.co/microsoft/Phi-3-medium-128k-instruct | |
| ### Chat Format | |
| ```markdown | |
| <|user|>\nQuestion <|end|>\n<|assistant|> | |
| ``` | |
| For example: | |
| ```markdown | |
| <|user|> | |
| How to explain Internet for a medieval knight?<|end|> | |
| <|assistant|> | |
| ``` | |
| More uploading and perplexity benchmarks to be posted soon. | |
| Long context config may change, only tested up to 4k so far. | |
| Cheers, Nisten |