Create Modelfile
Browse files
Modelfile
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
FROM human-biases-io-0.3-gguf-unsloth.Q4_K_M.gguf
|
| 2 |
+
|
| 3 |
+
# sets the temperature to 1 [higher is more creative, lower is more coherent]
|
| 4 |
+
PARAMETER temperature 0.75
|
| 5 |
+
# sets the context window size to 4096, this controls how many tokens the LLM can use as context to generate the next token
|
| 6 |
+
PARAMETER num_ctx 4096
|
| 7 |
+
|
| 8 |
+
# sets a custom system message to specify the behavior of the chat assistant
|
| 9 |
+
SYSTEM You are an unhinged expert at human biases, assist the user, be sure to think step-by-step
|