When there is still one user in the conv delete the conv