Revert "Do not kill app when closing floating window"

This reverts commit 1168a6e3af050687448e5d534a3aa584790ea983.