Each server is now started in a new directory to allow custom configs

Later this will be used to run tests which require several servers running on the same machine but on different ports.