Unref GFile objects in any case, not only if moving is done.