adding memoizer to token stream consumer