Make sure path is what we want, even in bash