Fix prefetch_related only selecting the join field for main query