Use the 'delete ROI on this slice' button (it shows a pencil erasing information) to remove the ROI only from the slice you are currently viewing.
(it; shows; a pencil erasing information) (a pencil; erasing; information) (the slice; are viewing; T:currently)
it a pencil the slice
shows erasing are viewing
a pencil erasing information
information
T:currently