PYTHON_SITE_PACKAGE add too much path in it for --prefix, --prefix does add lib/python/site-package for us