Don't mess with default-directory of dired buffers