Actually run all tests

Make the test servers run on random ports and use different filenames to avoid
conflicts.