Remove user if one of his followed channels is removed