Fix inefficient interactive-navigation guarding.

With minor restructuring.
Optimize panning guard ordering.