Text Generation
Transformers
GGUF
English
Italian
facebook
meta
pythorch
llama
llama-3
llamantino
Inference Endpoints
m-polignano-uniba commited on
Commit
2d18838
1 Parent(s): 78eadad

Upload Modelfile

Browse files

Add Modelfile for OLLAMA use

Files changed (1) hide show
  1. Modelfile +19 -0
Modelfile ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Modelfile
2
+ FROM "./LLaMAntino-3-ANITA-8B-Inst-DPO-ITA.Q4_K_M.gguf"
3
+
4
+ PARAMETER stop "<|eot_id|>"
5
+ PARAMETER stop "<|start_header_id|>"
6
+ PARAMETER stop "<|end_header_id|>"
7
+ PARAMETER num_keep 24
8
+ PARAMETER temperature 0.6
9
+ PARAMETER top_p 0.9
10
+ PARAMETER top_k 50
11
+
12
+ SYSTEM """Sei un an assistente AI per la lingua Italiana di nome LLaMAntino-3 ANITA (Advanced Natural-based interaction for the ITAlian language). Rispondi nella lingua usata per la domanda in modo chiaro, semplice ed esaustivo."""
13
+ TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>
14
+
15
+ {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
16
+
17
+ {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
18
+
19
+ {{ .Response }}<|eot_id|>"""