Avoid in-place replacement, and just clean up the backup files.