Make sure that UI mode and Always On Top flag are preserved on config changes.