microsoft
/

Phi-3-mini-4k-instruct-gguf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Phi-3-mini-4k-instruct-gguf / Modelfile_q4

gugarosa's picture

chore(root): Initial documentation upload.

06d1ea4 8 months ago

141 Bytes

	FROM ./Phi-3-mini-4k-instruct-q4.gguf
	TEMPLATE """<\|user\|>
	{{.Prompt}}<\|end\|>
	<\|assistant\|>"""
	PARAMETER stop <\|end\|>
	PARAMETER num_ctx 4096