Remove unnessesary boost linking when not using boost shim