Also restore plugin folder state after plugin reload