The lemma we were looking for

See http://math.columbia.edu/~dejong/wordpress/?p=1564

Actually, it is pretty clear that you can make the argument work for the
non-Noetherian case as well.