Add "assume_prefetch" option for ToManyIdField

This will cause it to use the (prefetched) resources and fetch the
pk field from that instead of issuing another query for the pks