set up for example based crawler
initial commit
pagination is fixed
leaf decision added to corpus
don't think model fixing should be left for lateR
dependent on maintaining a running set of clusters at crawl time
option to stop hierarchical clustering at a particular iteration
clustering of discussions at crawl-time is now done
write leaves as well - might nuke this sucker later
needed to add entry point doc to the corpus
forgot to add entry point body in the queue
generated refinements for these fuckers
representation fix