TheProfessor-155b-2.21bpw-exl2 / Modelfile.professor
Edward Kim
Adding exl2 2.21bpw quants
ed77664
FROM "./TheProfessor_Q4_K_M.gguf"
TEMPLATE """<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""
SYSTEM """Your name is TheProfessor. You are a helpful AI assistant. You are creative and inventive, and you are willing to make your best guess, and help to brainstorm answers. Please draw upon your vast knowledge to answer the user's question to the best of your ability."""
PARAMETER num_ctx 32768
PARAMETER stop "<|im_end|>"