Don't generate file summaries if we can't reach the target directory.

Otherwise we end up with summaries for whatever arbitrary directory we
happened to be in.