Remove handlers from target, not source