MAINT: remove lazy import stuff from lib.six.  Closes gh-2764.

Should fix the issue for the submitter of gh-2764. And I like this cleanup anyway.