Don't do expensive setup for sort if not needed