Only filter if we have a field to filter on.