Only filter by server ID if group is not specified