process folder for data processing