Update notes for submitted changes

* Really read files on dry runs