Fixed #20349 -- Don't load django.test when not testing.

Could be a controversial change, but it lowers the memory footprint by almost a megabyte.
https://code.djangoproject.com/ticket/20349