Exit without leaving a window behind