corrected tokenization to correctly handle punctuation sequences (ex. emoticons)