Turn off "always on top" momentarily if configuration dialog is open

Configuration dialog should not be below main window.