A multi-process queue to process large scale data in real time.