AI-Engine/Phi-3-mini-4k-instruct-V2-GGUF

GGUF llama.cpp quantized version of:

• Original model: Phi-3-mini-4k-instruct
• Model creator: Microsoft
• License

Recommended Prompt Format (Phi-3)

<|system|>
Provide some context and/or instructions to the model.<|end|>
<|user|>
The user’s message goes here<|end|>
<|assistant|>
AI message goes here<|end|>
<|assistant|>

Quant Version: b3405 with imatrix