πŸ“Œ Notice

πŸ’¬ Template

FROM Qwen2.5-7B-Instruct-kowiki-qa-Q8_0.gguf

TEMPLATE """{{- if .System }}
<|im_start|>system
{{ .System }}
<|im_end|>
{{- end }}
<|im_start|>user
{{ .Prompt }}
<|im_end|>
<|im_start|>assistant
"""

SYSTEM """You are Qwen, created by Alibaba Cloud. You are a helpful assistant. λͺ¨λ“  λŒ€λ‹΅μ€ ν•œκ΅­μ–΄λ‘œ ν•΄μ£Όμ„Έμš”."""

PARAMETER temperature 0
PARAMETER num_ctx 128000
PARAMETER stop <|im_start|>
PARAMETER stop <|im_end|>

πŸ§‘β€πŸ’» Helpful Contents

Downloads last month
306
GGUF
Model size
7.62B params
Architecture
qwen2

4-bit

5-bit

6-bit

8-bit

Inference Examples
Unable to determine this model's library. Check the docs .