Suppress duplicate confirm dialog on remove

Fixes #2533