use mechanize, to respect robots.txt