Revert "Build for Python 3.2 on Travis."

This reverts commit 2b6e260f6e82879706ba2dea6d0e8a1f3a065191.