Backups are stored inside user-emacs-directory.