fuck status codes, scrape whatever we can get, error or not.
add connection test worker that checks to see if network connection exists. by removing status codes (b/c fuuuuu), no wifi connection means it still passes through. sidekiq update.