Close connection to caller after notifying of port num