Fixes a bug that SignalMap#unmapListeners method removes other listeners.