add token pre processor