Fix 32bit build

Similar to the fix for #2291.

Twitter conversation: https://twitter.com/chuhnk/status/535906099351003136

To test this out, add `linux/arm` to `KUBE_SERVER_PLATFORMS` in `hack/lib/golang.sh`.
You realize this is going to start off by asking for a large, negative amount of memory on 32 bit systems, right?