Prepare toggling on/off Plugins

Also create a extra config for Plugins.