tokyotech-llm

/

Swallow-7b-instruct-hf

like 39

If anyone wants to use HF's new chat templates here's the formatting exactly matching the output docs:

tokenizer.chat_template = "{% if not add_generation_prompt is defined %}{% set add_generation_prompt = false %}{% endif %}{% for message in messages %}{% if message['role'] == 'system' %}{{ message['content'] + '\n\n' }}{% elif message['role'] == 'user' %}{{'### 指示:\n' + message['content'] + '\n\n'}}{% elif message['role'] == 'assistant' %}{{'### 応答:\n' + message['content'] + '\n\n'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '### 応答:' }}{% endif %}"

The roles are system, user, and assistant, and you could start with the suggested prompt:

PROMPT = "以下に、あるタスクを説明する指示があります。リクエストを適切に完了するための回答を記述してください。"
chat = []
chat.append({"role": "system", "content": PROMPT})