dump text streams into a directory and read the data back intelligently