Don't unwatch a directory on flushing the parent directory