Turn off `diff-auto-refine-mode' when entering `diff-mode'.