Add post-prereq phase

This is handy for fixing up things like python modules after pip is installed