app: Fix the close button after drag-n-drop

https://bugzilla.gnome.org/show_bug.cgi?id=731998