need the invite handle so we can uninvite it later, this was a regresion
and this fixes #230.