analyze the href network in the downloaded pages
some unsaved changes
calculating tfidfs, soon will calculate shared hrefs
constructing a url->hrefs pickle
analysis by full dates. preparing urls to hrefs dataset
hrefs network
consecutive network for either ngrams or hrefs.
interesect shareables and hrefs
starting the feature extraction
preparing to re-extract ngrams
analyze and dump to tsv
cleanup