Fixed #20349 -- Don't load django.test when not testing.

Could be a controversial change, but it lowers the memory footprint by almost a megabyte.