Rollback when remove or set fails