Update json.config to account for beginning and end of document tokens

#18

by ecdouglas - opened Mar 6

base: refs/heads/main

←

from: refs/pr/18

Discussion Files changed

-1

ecdouglas

Mar 6

Currently, this model fails when you pass it a token length of 514 and set truncation=True, because two additional tokens are added (beginning and end of document). Truncating input strings at 512 will prevent this error from occuring.

Update json.config to account for beginning and end of document tokensc8249c33

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Ready to merge

This branch is ready to get merged automatically.

· Sign up or log in to comment