in shell script:
add gzip as an option ( gzipped list doesn't work with daemon 2.84 )
rework urls list into k/v array, makes list management easier
suppress output if non-interactive ( cron jobs )