remove tokenize-dependent functions