Try doing more caching

I'm wondering if setting the `PYTHONUSERBASE=` and caching that will be helpful...