Add rudimentary check of plugin configuration