Admin performance tweaks

* Only load plugin if admin
* Only load settings class admin_init if on edit, plugin, or settings page