Only auto-warp when there's somewhere to go