BSdl.py for downloading Belgisch Staatsblad

# fast script to download articles from Belgisch Staatsblad website
#
based on script by Tom Ruette, November 1, 2010
#
# Extensions
# -
makes an index of all files downloaded
# - adds information to index
from the Belgisch Staatsblad TOC web pages about the edition, section
and source department from which the document originated
# - larger set
of html codes converted to unicode
# - has error catching for
temporarily unreachable sites
# - also collects index information for
previously downloaded files without overwriting these files
# - script
can be restarted based on last downlaoded file in index