Skip pyobject.so if linking to libpythonx.y breaks