Modify reply queue in provision server configs