removed non-directories from the results of read_scanned_docs