Remove non-authenticable friends when leaving game