Changed crawler back to using decoded tokens