add discard_links_n_headers option, implement discard links and headers. use SizedQueue 100 for page_queue. implement kill_threads, allow user to kill thread manually