Avoid in-place replacement, and just clean up the backup files.

Just use named backups.

See #475.