remove multi authenticators for a listener