Alert user if navigating away before skip pref set

Fixes bug 70303.

Change-Id: I6e2d1d4444275d021fd85058e256cd65ef179cdd