Fixes for building 32bit.

r? @zwarich 
I would prefer that we don't set `CC` to `gcc -m32` and instead pass `-m32` as a flag.