The purpose of the processing. Unprocessed Available Data. The pipeline may be made to loop according to the amount of input data or infinitely. Notice also that more than one dsrishell may be running at any time. The dsrishell logs execution to a processing log.
Programs log errors and debugging messages to individual log files.
Processing configuration and parameter files are also kept, as part of the processing log. All this is done on a per session basis. The dsrishell interacts with the processing database. It reserves available files for processing and releases them when processing is done. The processing database is based on the normal UNIX file system, using a directory structure that reflects the existing data types, and some parameters related to data.