Handle activating and deactivating a bit better, make sure sidebar is only showing on one window