pacozaa
/

mistral-unsloth-chatml-first

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

mistral-unsloth-chatml-first / Modelfile

pacozaa's picture

Upload Modelfile with huggingface_hub

7032c2c verified 2 months ago

raw history blame contribute delete

No virus

205 Bytes

	FROM ./mistral-unsloth-chatml-first-unsloth.Q4_K_M.gguf

	TEMPLATE """<\|im_start\|>user\n{{ .Prompt }}<\|im_end\|> \n<\|im_start\|>assistant\n"""
	PARAMETER stop "<\|im_start\|>assistant\n"
	PARAMETER num_predict 64