Stop listening to events on remove controls