switched output to load .pages and .items into mongo before attemping to genereate output file. iterrating through files was to slow, iterating over mongo result set was much faster, can also add index at later date for added speed