Split _toggleEventHandlers into dedicated set... and remove..., to ensure that all listeners are removed correctly when setDisabledInputMethods() is called with new values