Remove all listeners on map state shutdown