MainWindow: Don't add the settings button twice