1 epoch of Needle In The Haystack dataset converted to my version of the prompt template.
bca0a65
verified
| { | |
| "<|assistant|>": 32001, | |
| "<|endoftext|>": 32000, | |
| "<|end|>": 32007, | |
| "<|placeholder1|>": 32002, | |
| "<|placeholder2|>": 32003, | |
| "<|placeholder3|>": 32004, | |
| "<|placeholder4|>": 32005, | |
| "<|placeholder5|>": 32008, | |
| "<|placeholder6|>": 32009, | |
| "<|system|>": 32006, | |
| "<|user|>": 32010 | |
| } | |