call tokenizer directly

#1
by johngiorgi - opened
Allen Institute for AI org

The instructions call the tokenizer from self.tokenizer. Looks like this is some kind of copy/paste error. Simple fix is to call the tokenizer that was initialized directly

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment