Adding a --dry-run option to the run command to make it possible to run without talking to the server. This made it possible to re-enable some tests.