Eliminate platform specific builds

This allows us to ship a single AnyCPU build that supports 32 and 64
bit. I'm not happy with the solution, but there aren't many options to
make this work.

Hopefully this didn't break OSX & Linux in the process.