Convert run tests to python

Convert the run tests scripts fro shell to python, so it's easier to hack and extend,
Right now, it's meant to do exactly the same as the replaces shell code.
Not current behaviour, but I'm OK with adding that now.