Only notifiy invitees server if we haven't already