extract logging setup to utils
oops, I should've made app_name a parameter. Fixed. Also, simpler log_levels lookup.
simplify ensure_whole_url
tweaks, mostly formatting
more suggested reformatting
extract percentage(). Also, tighten up set_up_logger().
minimize the scope of the with-block
tweaks
reorder methods to accord with the flow at runtime. That's just one reasonable order; the order was pretty random before as far as I could tell.
move comment to the statement it applies to
Putting main() first to go better with the order I chose for the rest of the code.
tweaks, plus extract collect_links().
extract name_file()
formatting tweak
I don't see why soup is an instance variable; making it local. Also a tweak.
this order seems a bit smoother
formatting
repeat_counter loop was hard to follow. Changed the code and the comments.
renamings