undone inverse Anscombe transform for mask calculation