Change directory when running test, this mimics what RunManager does