Don't delete the plugin unless you want to lose the content. Keep the plugins installed to allow all pages to load perfectly.