Add test for plugins.on|off overrides