Do not attempt to set port if it's not set