A nonexistent directory in PKG_CONFIG_PATH should not be an error

pkg-config itself does not consider it an error if a directory that is
listed in PKG_CONFIG_PATH does not exist. Instead of raising an
exception if a directory does not exist, simply don't search it.