Remove binding to secondary-lateral-panel setting before remove the plugins.
Hide the menu option to show/hide the second lateral by default.