README.md · AI-Engine/Phi-3-medium-128k-instruct-GGUF at main

metadata

license: mit
tags:
  - gguf
  - phi-3

NOTE: Requires 128k context support -> https://github.com/ggerganov/llama.cpp/releases/tag/b2961.

GGUF llama.cpp quantized version of:

Original model: Microsoft/Phi-3-medium-128k-instruct
Model creator: Microsoft
License

Recommended Prompt Format (Chat Format)

<|user|>
Provide some context and/or instructions to the model.<|end|>
<|assistant|>
AI message goes here<|end|>
<|user|>
The user’s message goes here<|end|>
<|assistant|>