cmake: stop linking swig libs against libwyliodrin.so and make parralel ...

...compilation safe

Signed-off-by: Brendan Le Foll <brendan.le.foll@intel.com>