File size: 502 Bytes
0dd15b7 17699d5 a97e0ba 17699d5 a97e0ba |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
---
license: apache-2.0
---
forked from https://huggingface.co/huggyllama/llama-13b/tree/main
This tokenizer supports [`Birchlabs/llama-13b-stepwise-adapter`](https://huggingface.co/Birchlabs/llama-13b-stepwise-adapter).
Adds four new tokens for stepwise reasoning:
```
<|step_start|>
<|step_end|>
<|answer_start|>
<|answer_end|>
```
See [`Birchlabs/llama-13b-stepwise-adapter`](https://huggingface.co/Birchlabs/llama-13b-stepwise-adapter) for details of how all the parts should be used together. |