shell: Hide the visible dialog when navigating

Fixes #822
Closes #947
Signed-off-by: Stef Walter <stefw@redhat.com>