Update notes for submitted changes

* Make sure tempest directories exist when modifying