Reduce number of queries in ToManyField

By checking to see if the_m2ms is null, and not whether it's null or empty, we prevent performing two of the same queries.