CB-7459 Allow auto tests to be run for specific plugin(s)

Address feedback on pull request:
- Separate setup of UI from defining auto tests.
- Remember user selections for enabled tests (persist across app runs via localStorage)