handle tokenizing [, ], and ? wildcards