Actually backup files when we fail to enable