Remove pluginProviderPackageDirs

This has been replaced by the pluginProviderPackageMap which is built at
a different level.