[gnome-base/gvfs] backport performance fix from stable branch