overhaul to iterate over directories and sub-directories

code successfully ran and extracted all comments data for all docs in
all challenges