Handle unlistable plugin jar cache dir for #402