Remove overridden plugins from the blacklist