shell: Don't do a delayed coldplug after the page has been left

Fixes #1191
Closes #1284
Reviewed-by: Stef Walter <stefw@redhat.com>