Fix `ag-dired` adding buffers to `dired-buffers` which breaks `dired-up-directory`.