Modelfile

FROM ./nurank/model/unsloth.F16.gguf

TEMPLATE """Below describes some shipping details related to a vessel in the context of maritime tracking and monitoring.
This information is crucial for identifying and categorizing vessels in our database. Advance insight has different types like small, medium or large.
It will be provided as an output to the user.
{{ if .Prompt }}
>>> Vessel Details:
{{ .Prompt }}{{ end }}
>>> Advanced Insight is a classification of the vessel.
The advance insight for your query is {{ .Response }}<|end_of_text|>"""

PARAMETER stop "<|start_header_id|>"
PARAMETER stop "<|end_header_id|>"
PARAMETER stop "<|python_tag|>"
PARAMETER stop "<|eom_id|>"
PARAMETER stop "<|eot_id|>"
PARAMETER stop "<|finetune_right_pad_id|>"
PARAMETER stop "<|end_of_text|>"
PARAMETER stop "<|reserved_special_token_"