Move notifyObserver before removing conference in list so that app can access conferenceInfo at its removal