update the InputClient to support batchs, TBD: 1- parameter parsing; 2- metrics collection; 3-word generation part