Allow callbacks to remove themselves

Removing others is undefined behavior and may lead to crashes/
vulnerable programs