Remove the default port

Docker doesn't use a default port now anyway, so no reason to keep this
around