move tokenize to standard location to make general use thereof