Remove the pkgconfig removals!

This breaks a lot of code when you use pkg-congfig,
it was actually trashing the whole of conda...