Don't add -m32 to C++ flags

We don't use C++ so it's redundant. The Plugin module takes care of them in
case of plugins.