phi3-mini-WeatherBot / Modelfile_q4
VatsalPatel18's picture
Upload Modelfile_q4 with huggingface_hub
ab49137 verified
raw
history blame
251 Bytes
FROM ./Phi-3-mini-4k-instruct-q4.gguf
TEMPLATE """<s>{{ if .Prompt }}<|user|>
{{ .Prompt }}<|end|>
{{ end }}<|assistant|>
{{ .Response }}<|end|>"""
PARAMETER stop <|endoftext|>
PARAMETER stop <|assistant|>
PARAMETER stop <|end|>
PARAMETER num_ctx 4096