Removed tag before-big-changes
[RTLInfo] extract intro, embedded videos. Detects when a frontpage url redirects to some internal blogpost, and discard it.
[RTLInfo] but what is a usable link?
[RTLInfo] added some actual documentation info
[DHNet] clean up formatting for in-text links
added rtlinfo as provider for the crawler. All provider now returns two lists (news items and possible blogposts)
[SudPresse] using a utility func
Added tag v0.4.0 for changeset c457cad767c9
JSON MODULE, Y U NO SERIALIZE SETS
Added tag v0.4.1 for changeset 21aae99327f3
[DHNet] some error handling for when the website is broken
Added tag v0.4.2 for changeset f72597d853a8
project reorganisation

--HG--
rename : src/crawler.py => src/crawler/crawler.py
rename : src/make_figures.py => src/crawler/make_figures.py
rename : src/providerstats.py => src/crawler/providerstats.py
rename : src/show_stats.py => src/crawler/show_stats.py
rename : src/parsers/__init__.py => src/datasources/__init__.py
rename : src/parsers/article.py => src/datasources/common/article.py
rename : src/parsers/utils.py => src/datasources/common/utils.py
rename : src/parsers/dhnet.py => src/datasources/dhnet.py
rename : src/parsers/lalibre.py => src/datasources/lalibre.py
rename : src/parsers/lesoir.py => src/datasources/lesoir.py
rename : src/parsers/rtlinfo.py => src/datasources/rtlinfo.py
rename : src/parsers/septsursept.py => src/datasources/septsursept.py
rename : src/parsers/sudpresse.py => src/datasources/sudpresse.py
rename : src/test_parsers/test_articledata.py => test_parsers/test_articledata.py
rename : src/test_parsers/test_utils.py => test_parsers/test_utils.py
new top level module name

--HG--
rename : src/bin/fetch_articles_from_queue => csxj/bin/fetch_articles_from_queue
rename : src/bin/update_toc_queue => csxj/bin/update_toc_queue
rename : src/crawler/crawler.py => csxj/crawler/crawler.py
rename : src/crawler/make_figures.py => csxj/crawler/make_figures.py
rename : src/crawler/providerstats.py => csxj/crawler/providerstats.py
rename : src/crawler/show_stats.py => csxj/crawler/show_stats.py
rename : src/datasources/__init__.py => csxj/datasources/__init__.py
rename : src/datasources/common/__init__.py => csxj/datasources/common/__init__.py
rename : src/datasources/common/article.py => csxj/datasources/common/article.py
rename : src/datasources/common/utils.py => csxj/datasources/common/utils.py
rename : src/datasources/dhnet.py => csxj/datasources/dhnet.py
rename : src/datasources/lalibre.py => csxj/datasources/lalibre.py
rename : src/datasources/lesoir.py => csxj/datasources/lesoir.py
rename : src/datasources/rtlinfo.py => csxj/datasources/rtlinfo.py
rename : src/datasources/septsursept.py => csxj/datasources/septsursept.py
rename : src/datasources/sudpresse.py => csxj/datasources/sudpresse.py
removed useless crap
moved scripts to top level scripts/ dir

--HG--
rename : csxj/crawler/make_figures.py => scripts/make_figures.py
rename : csxj/crawler/show_stats.py => scripts/show_stats.py
csxj is now a package
sample script uses the new csxj package
updated the imports to reflect new package structure
extracted runnable crawling script. crawler.py module only provides a bunch of functions

--HG--
rename : csxj/crawler/crawler.py => csxj/crawler.py
rename : csxj/crawler/providerstats.py => csxj/providerstats.py