Remove Python 3.2

Matplotlib will somehow not build under Python 3.2 on Travis-CI