Remove python 3.2 from the build matrix. I don't want to add six or similar stuff only because http://legacy.python.org/dev/peps/pep-0414/