major bug fixed. tokenization now works