Remove plugin lookup based on plugin object, not on plugin name