Actually add port & host from config to listener