webpage scrapping

webpage scrapping using different modules for connection i.e. ntlm
[intranet] , digest , basic auth depending upon the requirement