Fix an issue where an exception occured while the plugin wasn't yet configured