if you start the server on an ephemeral port (by specifying '0' in the config) then you can guarantee it'll be free during tests. (see https://github.com/dropwizard/dropwizard/blob/master/dropwizard-testing/src/main/java/io/dropwizard/testing/junit/DropwizardAppRule.java#L110)