Try to set link and compile flags for correct toolchains and operating systems

Getting ready to try bjam with msvc, and gcc/clang compiler flags won't work

We'l problably ignore compiler options on MSVC until the lib builds properly