Cleanup maildir after default run