[RFC] Configure travis to perform a 32-bit build

To prevent errors such as the one uncovered by @elmart at #574, this will extend the build matrix with a full 32-bit build/test of the project. CC @jszakmeister