Find the path to site-packages properly when patching