Remove SWIG dependency. When using Python we seem to prefer Cython anyways.