Don't remove handler from pipeline if not there