avoid attempting to read hidden files, handle unicode decode errors more nicely
add test for invalid document reading