Update notes for submitted changes

* Some checks depend on the directory existing