.travis.yml: Remove py32

because Python 3.2 is kind of old and Python 3.2 takes way longer on Travis CI vs. other Python 3.x versions.

Fixes: GH-2164