Don't use g_source_remove for signal handlers

This fixes reliable crashes when changing bookmarks or the read later
list if any single window has been closed.