Don't silently fail when there are no targets to remove punishments for