add force reupload feature, and faillure logging