refactored tokenizing after giving flexibility, order, and the need to avoid sets in order to build most frequent word dict