cmake: stop linking swig libs against libwyliodrin.so and make parralel compilation safe

Signed-off-by: Brendan Le Foll <brendan.le.foll@intel.com>