Unflagging would be nice, but I think it's not mandatory since you are asked very carefully if you want to flag it.

If there's an easy way to implement it, why not.