Ensure we aren't ticking past view distance minus safe tick buffer