modified scraper to allow both top-level and dept-level to be filled in
top-level and dept-level added indep.
Deal with 302 redirects
Some code syntax clean up