Move configuration of plugin to admin interface
Handle the bizarre configuration API in one place